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Executive  Summary 

Purpose 

As  a  nation  competing  in  a  global  economy,  the  United  States  depends 
heavily  on  innovation  through  research  and  development  (rad).  Because 
small  business  has  been  identified  as  a  principal  source  of  significant 
innovation,  the  Small  Business  Innovation  Research  (sbir)  Program  was 
established  in  1982  to  strengthen  the  rad  role  of  small,  innovative 
companies.  As  part  of  its  oversight  of  the  program,  which  is  scheduled  to 
expire  in  1993,  the  Congress  directed  gao  to  evaluate  the  aggregate 
commercial  trends — ^primarily  sales  of  products — ^in  the  third,  or  final, 
phase  of  the  program. 

Background 

Eleven  federal  agencies  participate  in  the  program.  Five  of  them — the 
Department  of  Defense  (dod),  the  National  Aeronautics  and  Space 
Administration  (nasa),  the  Department  of  Health  and  Human  Services 
(hhs),  the  Department  of  Energy  (dob),  and  the  National  Science 
Foundation  (nsp) — provide  over  ^  percent  of  sbir  funds.  Each  manages  its 
own  program,  while  the  Small  Business  Administration  (sba)  ph^  a 
central  administrative  role  and  has  published  policy  directives  and  annual 
reports  for  the  program. 

SBIR  legislation  requires  a  three-phase  process  for  sbir  projects.  Phases  I 
and  n  are  intended  to  develop  an  innovative  idea.  Phase  III  generally 
involves  the  use  of  nonfederal  funds  for  commercial  application  of  a 
technology,  or  non-SBIR  federal  funds  for  government  contracts  for 
government  application. 

Results  in  Brief 

Even  though  many  sbir  projects  have  not  yet  had  sufBcient  time  to  achieve 
their  full  commercial  potential,  the  program  is  showing  success  in  Phase 
m  activity.  As  of  July  1991,  the  program  had  generated  about  $1.1  billion  in 
Phase  m  sales  and  additional  fimding  for  technical  development — two  key 
indicators  of  the  program's  commercial  trends.  In  addition,  up  to  $3  billion 
more  is  expected  by  the  end  of  1993.  The  m^uority  of  this  activity  occurred 
in  the  private  sector,  showing  a  trend  toward  one  of  the  program’s 
goals — ^increasing  private-sector  commercialization. 

However,  the  nuyor  sam  agencies  differ  in  their  responses  to  this  goal,  as 
shown  by  their  wide  variation  in  average  sales  per  project,  which  ranged 
from  a  low  of  $161,000  for  nasa  to  a  high  of  $677,000  for  hhs.  Another 
difference  is  that  the  percentage  of  project  sales  to  the  private  sector 
ranged  from  a  low  of  40  percent  for  dod  to  a  high  of  92  percent  for  hhs. 
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Although  the  program  is  showing  success  in  Phase  m,  three  issues  that 
affect  Phase  m  activity  need  to  be  addressed:  (1)  the  extent  of  dod’s 
commitment  to  the  goal  of  increasing  private-sector  commercialization, 
(2)  inconsistent  practices  in  requiring  competition  for  projects  entering 
Phase  m,  and  (3)  the  need  to  clarify  the  circumstances  under  which  an 
agency  may  work  on  its  own  or  continue  working  with  the  company 
through  follow-on  contracts  after  sem  fimding  ends.  Another  issue,  the 
lower  Hiase  m  sales  and  additional  funding  by  companies  with  five  or 
more  Phase  n  awards,  is  being  addressed  by  sba. 


Principal  Findings 


SBIR  Fums’  Sales  and  To  obtain  information  on  the  Phase  m  results  of  sent,  gao  surveyed  all 

f^inding  Phase  11  awards  made  in  1984  through  1987;  ihe  survey  ciqptures  most 

projects  now  in  Phase  m.  According  to  the  siuvey  responses  for  1,457 
projects,  939  active  projects  have  achieved  sales  and/or  additional 
developmental  funding  already  or  expect  them  by  the  end  of  1993.  Another 
518  projects  are  no  longer  active  for  reasons  such  as  insufficient  additional 
fimding  for  further  technical  development 

SBiR  firms  reported  about  $1.1  billion  in  Phase  in  activily,  consisting  of 
$471  million  in  sales  and  $646  million  in  additional  devdopmental  funding, 
through  July  1991.  About  65  percent  of  the  sales  and  56  percent  of  the 
additional  developmental  fimding  occurred  in  the  private  sector. 
Companies  foresee  almost  $2  billion  in  sales  fix>m  these  sbir  projects 
between  July  1991  and  the  end  of  1993.  They  expect  between  $335  million 
and  about  $1  billion  in  additional  fimding  through  the  end  of  1993. 


/aried  Commercialization  Agencies  show  wide  variations  in  commercialization  trends.  Agency  sales 
)y  Agencies  P®*"  project  ranged  fi’om  $161,000  for  nasa  to  $677,000  for  hhs,  while  the 

percentage  of  project  sales  to  the  private  sector  ranged  from  40  percent 
for  Doo  to  92  percent  for  hhs.  One  reason  for  these  differences  is  the  wide 
variation  in  markets  for  sbir  products  or  processes.  For  exanqile,  many 
DOD  projects  are  limited  to  specialized  militaiy  ^plications  within  dod, 
whereas  hhs  projects  have  access  to  a  vigorous  biomedical  market  in  the 
private  sector.  In  addition,  dod  is  emphasizing  a  closer  link  between  its 
projects  and  its  agency  mission,  while  nasa,  doe,  and  nsf  are  taking  steps 
to  emphasize  private-sector  commercialization. 
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Issues  in  Phase  HI  Activity  Four  issues  emerged  from  GAO’S  review  of  Phase  III  activity.  The  first  issue 

involves  differences  between  dod  and  the  other  nuyor  sbir  agencies  about 
the  program  goal  of  increasing  private-sector  commercialization,  dod  is 
placing  less  emphasis  on  commercialization  than  on  meeting  its  own  rad 
needs  through  the  program;  dod’s  projects  have  also  made  a  lower 
percentage  of  their  sales  to  the  private  sector  than  those  of  the  other 
nuOor  sent  agencies.  If  dod  is  to  give  greater  emphasis  to 
commercialkation,  one  £q)proach  would  be  to  select  projects  that  involve 
“dual-use”  technologies  ctqpable  of  meeting  civilian  as  well  as  military 
needs.  For  example,  nine  dod  projects  responding  to  the  gao  survey 
achieved  sales  of  $500,000  or  more  to  both  dod  and  the  private  sector. 

A  second  issue  involves  a  question  about  the  need  for  further  competition 
in  awarding  a  Phase  in  contract  when  an  sbir  project  has  already 
competed  successfully  in  Phases  I  and  II.  dod  and  nasa  officials  have 
expressed  a  need  to  clarify  the  contractual  procedures  that  should  be 
followed  when  entering  into  a  foUow-on,  non-SBIR-funded  production 
contract  under  Riase  ni.  These  officials  are  unsure  how  the  competition 
requirements  of  the  Competition  in  Contracting  Act  of  1984,  as  amended 
(acA),  apply  to  such  contracts.  Because  the  competition  requirements  are 
being  applied  inconsistently,  gao  believes  that  clarifying  this  issue  would 
help  achieve  uniformity  in  contract  practices. 

A  third  issue  raises  a  question  of  who — the  federal  agency  or  the  company 
that  developed  an  sbir  technology — should  perform  additional  work  for 
the  government  after  sbir  funding  ends.  This  issue  has  led  to  serious 
conflict  in  one  case,  resulting  in  the  loss  of  a  possible  multimillion-dollar 
contract  for  a  company  because  an  agency  continued  work  on  the 
company’s  project  without  further  involving  the  company.  No  existing 
program  guidance  addresses  this  issue,  but  such  guidance  could  help  to 
avoid  conflict  between  companies  and  federal  agencies. 

The  fourth  issue — ^the  lower  Phase  IB  sales  and  additional  developmental 
funding  by  companies  with  multiple  Hiase  n  awards — ^is  being  addressed 
by  SBA.  SBA  initiated  a  study  of  the  operating  attributes  of  these  fiLms  in 
August  1991  and  expects  to  complete  the  study  in  early  1992. 


Matters  for 

Congressional 

Consideration 


To  further  the  goal  of  increasing  private-sector  commercialization,  the 
Congress  may  wish  to  consider  whether  dod  should  place  greater 
emphasis  on  commercialization  through  such  means  as  giving  preference 
for  SBIR  awards  to  projects  that  involve  dual-use  technologies.  To  eliminate 
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^ency  Comments 


inconsistent  agency  practices  in  requiring  competition  for  federal, 
non-SBIR-fiinded  contracts  after  Phase  n,  the  Congress  may  wish  to  clarify 
whether  Phase  m  activity  must  comply  with  aCA’s  competitive  procedures 
or  whether  the  competition  in  the  earlier  phases  of  the  program  satisfies 
the  acA  requirements.  To  avoid  misunderstandings  between  companies 
and  federal  agencies,  the  Congress  may  wish  to  require  the  sba 
Administrator  to  develop  a  policy  directive  for  agencies  that  are  planning 
to  work  on  a  company’s  sem  technology  after  sbir  funding  ends.  Such  a 
directive  should  clarify  the  circumstances  under  which  it  may  be 
appropriate  for  an  agency  to  continue  working  with  a  company  through  a 
foUow-on,  non-SBIR-funded  contract. 


GAO  obtained  written  comments  from  dod,  nasa,  hhs,  nsf,  doe,  and  sba, 
which  generally  agreed  with  the  factual  information  in  the  report 
However,  dod  objected  to  the  comparison  of  dod’s  commercialization 
results  with  those  of  other  agencies  because  of  nuqor  differences  in 
agency  mission  that  affect  commercialization,  gao  agrees  that  these 
differences  do  affect  commercialization  but  believes  that  a  comparison  of 
sales  achieved  by  agencies’  projects  helps  in  understanding  the  extent  to 
which  agencies’  projects  are  able  to  develop  federal  and  private-sector 
markets.  In  its  matters  for  congressional  consideration,  gao  is  suggesting 
that  the  Congress  may  wish  to  consider  whether  dod  should  be  doing  more 
to  enhance  private-sector  commercialization. 

In  the  draft  report,  gao  recommended  that  the  sba  Administrator  develop  a 
policy  statement  for  agencies  planning  to  work  on  a  company’s  sbir 
technology  after  sbir  funding  ends,  gao  believes  that  sba  has  broad 
statutory  authority  to  issue  a  policy  directive  on  the  general  conduct  of  the 
SBIR  Program,  sba  does  not  di^laim  such  authority  but  did  not  concur  with 
this  recommendation  because,  in  its  view,  present  legislation  does  not 
specifically  address  sba’s  authority  to  establish  program  policy  over 
non-SBIR  funding  agreements  entered  into  under  Phase  ni.  In  light  of  this 
concern,  the  Congress  nu^r  wish  to  consider  requiring  sba  to  issue  a  policy 
directive  for  Phase  HI. 

'The  agencies  also  suggested  various  technical  changes  that  have  been 
incorporated  where  iqjpropriate. 
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Chapter  1 _ 

Introduction 


The  Small  Business  Innovation  Development  Act  of  1982,  which  authorizes 
the  Small  Business  Innovation  Research  (sbir)  Program,  emphasized  the 
benefits  of  technological  innovation  and  the  ability  of  small  businesses  to 
transfonn  research  and  development  (rad)  results  into  new  products.  The 
act  observed  that,  while  small  business  is  the  principal  source  of 
significant  innovation  in  the  nation,  the  vast  m^ority  of  federally  funded 
RAD  is  conducted  by  large  business,  universities,  and  government 
laboratories. 

In  authorizing  the  sbir  Program,  the  Congress  designated  four  nuyjor  goals: 

•  To  stimulate  technological  iimovation. 

•  To  use  small  business  to  meet  federal  rad  needs. 

•  To  foster  and  encourage  participation  by  minority  and  disadvantaged 
persons  in  technological  innovation. 

•  To  increase  private-sector  commercialization  innovations  derived  fi^m 
federal  rad. 


Thp  Administratiori  of  in  addition  to  establishing  goals,  the  legislation  determined  agency 
V,  OOTID  TK-  participation  and  funding  for  the  program.  Agencies  spending  more  than 

tn6  bBlR  Program  $100  mUllon  aimually  for  external  rad  are  required  to  set  aside  not  less 

than  1.25  percent  of  their  total  rad  funds  for  sbk.  At  present,  11  agencies 
participate  in  the  program.  The  five  largest,  accounting  for  well  over  90 
percent  of  all  sbir  awards,  include  the  Department  of  Defense  (dod),  the 
Department  of  Energy  (doe),  the  Department  of  Health  and  Human 
Services  (hhs),  the  National  Aeronautics  and  Space  Administration  (nasa), 
and  the  National  Science  Foundation  (nsf).  The  other  six  agencies,  which 
account  for  the  remainder  of  the  awards,  include  the  United  States 
Departmer  ‘  of  Agricultiu^  (usda),  the  Department  of  Ck)mmerce  (doc),  the 
Department  of  Education  (DOEd),  the  Department  of  Transportation  (dot), 
the  Environmental  Protection  Agency  (epa),  and  the  Nuclear  Regulatory 
Commission  (nrc). 

Each  agency  with  an  sbir  program  is  unilaterally  responsible  for  targeting 
research  areas  and  administering  its  own  sbir  funding  agreements,  sbir 
funding  agreements  include  any  contract,  grant,  or  cooperative  agreement 
entered  into  between  a  federal  agency  and  any  small  business  for  the 
performance  of  experimental,  developmental,  or  research  work  funded  in 
whole  or  in  part  by  the  federal  government. 


Page  12 


GAD/BCED'92-S7  SmaU  Boalacaa  lanvratioa  Beaearck 


Clupter  1 
Introdnctioii 


The  le^lation  requires  agencies  to  issue  a  solicitation  that  sets  the  sbk 
process  in  motion.  The  solicitation,  a  formal  document  issued  by  each 
agency,  lists  and  describes  the  topics  to  be  addressed  by  company 
proposals  and  invites  companies  to  submit  proposals  for  consideration. 

The  law  required  the  Small  Business  Administration  (sba)  to  issue  policy 
directives  for  the  general  conduct  of  the  SBm  Programs  within  the  federal 
government.  The  policy  directives  were  to  include  such  elements  of  the 
program  as  simplified,  standardized,  and  timely  sbir  solicitations;  a 
simplified,  standardized  funding  process;  and  minimization  of  the 
regulatoiy  burden  for  small  businesses  participating  in  the  program.  The 
first  policy  directive  was  disseminated  in  November  1982.  The  current 
policy  directive,  issued  in  June  1988,  provides  that  sba  may  issue 
additional  instructions  (as  additional  or  replacement  pages  for  the 
directive)  as  a  result  of  public  comment  or  experience.  Federal  agencies 
were  also  required  to  report  key  data  to  sba,  which  in  turn  has  published 
annual  reports  on  the  progress  of  the  program. 

To  be  eligible  for  an  sbir  award,  sba’s  sbir  Program  policy  directive  states 
that  small  businesses  must  be 

•  independently  owned  and  operated, 

•  other  than  the  dominant  firms  in  the  field  in  which  they  are  proposing  to 
cany  out  sbir  projects, 

•  organized  and  opersUed  for  profit, 

•  the  employer  of  600  or  fewer  employees  (including  employees  of 
subsidiaries  and  affiliates), 

•  the  primary  source  of  employment  for  the  project’s  principal  investigator 
at  the  time  of  award  and  during  the  period  when  the  research  is 
conducted,  and 

•  at  least  61  percent  owned  by  U.S.  citizens  or  lawfully  admitted  permanent 
resident  aliens. 

The  law  established  a  three-phase  structure  for  the  program.  The  first 
phase  is  designed  to  determine  the  scientific  and  technical  merit  and 
feasibility  of  a  proposed  idea.  The  second  phase  is  designed  to  further 
develop  the  idea.  According  to  sea’s  1988  directive,  agencies  ^ould  strive 
to  ensure  that  the  majority  of  Phase  I  awards  be  funded  at  $60,000  or  less 
and  not  exceed  a  6-month  period;  agencies  should  also  strive  to  ensure 
that  the  majority  of  Biase  n  awards  be  funded  at  $600,000  or  less  and  not 
exceed  2  years  of  work.  Only  about  1  in  26  original  proposals  for  a  Phase  I 
award  is  eventually  selected  for  a  Phase  11  award. 
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The  third  phase  of  SBm,  which  plays  the  central  role  in  this  report,  is 
somewhat  more  flexible  and  difficult  to  define.  Unlike  Phases  I  and  11, 
Phase  in  has  no  general  limits  in  time  or  dollar  amounts.  In  addition,  it  can 
include  not  only  federal  but  private-sector  funds.  The  law  indicates  that, 
where  appropriate,  the  third  phase  should  pursue  commercial  applications 
of  the  research  or  rad  and  may  also  involve  non-SBIR,  govemment-fimded 
production  contracts  with  a  federal  agency  for  products  or  processes 
intended  for  government  use. 


The  Importance  of 
Evaluating  SBIR’s 
Results 


Several  points  emphasize  the  importance  ol  evaluating  SBm’s  results.  As  a 
nation  competing  in  a  global  economy,  the  United  States  has  become 
dedicated  to  innovation  through  rad  as  a  way  of  life.  The  theme  of 
innovation  as  a  critical  factor  in  competitiveness  is  growing  more  evident. 

In  addition,  the  federal  government  and  the  private  sector  have  committed 
huge  sums  of  money  for  rad.  Based  on  the  latest  data  available  from  nsf, 
which  reported  on  rad  trends  in  1990,  total  rad  expenditures  were 
expected  to  reach  $150  billion  in  that  year,  the  15th  consecutive  year  of 
expanding  rad  spending.  The  federal  government  was  expected  to  provide 
$69  billion  (or  46  percent)  and  industry  $74  billion  (or  49  percent),  with 
most  of  the  remainder  coming  from  universities  and  colleges.  About  $21 
billion  was  estimated  to  be  spent  on  basic  research,  $34  billion  on  applied 
research,  and  $95  billion  on  development  in  1990.  Federal  support  for 
defense-related  rad  programs  accounted  for  much  of  the  increase  in  the 
spending  on  rad  during  the  1980s.  This  trend  has  slowed  somev^diat,  but 
DOD  still  accounted  for  an  estimated  62  percent  of  the  1990  federal  rad 
budget  authority. 

In  this  context,  the  evaluation  of  the  sbir  Program’s  results  is  especially 
important  for  several  reasons.  First,  the  program  covers  a  wide  range  of 
federal  rad  activities  and  offers  a  unique  opportunity  for  a  “bird’s  eye” 
view  of  federally  funded  rad.  Second,  the  program  emphasizes  the 
^applications  of  research,  thus  affording  a  further  opportunity  to  examine 
the  full  process  of  rad  from  initial  concept  through  entry  into  the 
marketplace.  Third,  by  itself,  the  program  has  expended  more  than  $2.6 
billion  in  federal  rad  and,  since  fiscal  year  1989,  has  been  providing  more 
than  $400  million  annually,  a  substantial  federal  outlay  whose  results 
should  be  reviewed. 

We  have  issued  six  reports  on  the  sbir  Program,  the  first  only  3  years  alter 
the  program  began.  A  detailed  review  of  the  program’s  accomplishments 
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in  Phase  m  is  particularly  timely  because  the  program  is  scheduled  to 
“sunset”  in  October  1993  and  is  again  being  considered  for  reauthorization. 
As  part  of  congressional  oversight  of  the  sbr  Program,  we  have  also 
testified  before  the  House  Small  Business  Committee  on  the  findings  and 
issues  discussed  in  this  report.* 


Objectives,  Scope, 
and  Methodology 


Public  Law  99-443  (dated  Oct  6, 1986)  required  gao  to  submit  two  reports 
to  the  Congress.  We  issued  the  first  report,  Federal  Research:  Assessment 
of  Small  Business  Innovation  Research  Programs  (gao/rcei>s»^),  in 
January  1989.  The  report  concluded  that  the  sent  agencies  were  making 
progress  toward  meeting  sbk's  four  goals  and  that  the  quality  of  SBm 
research  compared  favorably  with  other  federal  rad.  The  report  also 
contained  the  views  of  the  heads  of  all  1 1  federal  agencies  participating  in 
the  program;  their  views  indicated  a  consistently  favorable  response  to  the 
value  of  the  program.  The  report  contained  no  recommendations  or 
matters  for  congressional  consideration. 

The  law  mandated  two  objectives  for  the  second  study:  an  update  of  the 
previous  report  and  an  evaluation  of  Phase  m,  including  a  discussion  of 
the  aggregate  commercial  trends  for  products  that  are  currently  in  or  have 
completed  the  third  phase  of  the  program.  As  agreed  in  subsequent 
discussion  with  the  offices  of  the  congressional  Committees,  we  limited 
the  update  of  the  previous  report  to  further  information  on  achievement  of 
the  four  program  goals  and  agency  efforts  to  improve  the  program. 
Because  the  Committees  considered  information  relating  to  the  second 
objective  to  be  a  tmyor  factor  in  their  decision  about  reauthorization,  we 
have  focused  greater  atter^on  and  resources  on  the  evaluation  of  the 
second  objective. 

In  responding  to  the  first  objective,  we  conducted  a  survey  that  sought 
information  relating  to  the  achievement  of  the  four  program  goals  by 
Phase  n  participants.  This  information  was  used  to  update  the  findings  of 
the  previous  report  by  showing  how  sbir  projects  in  biases  II  and  m  are 
responding  to  each  of  the  goals.  We  talked  with  agency  officials  about 
their  efforts  to  improve  the  program  by  enhancing  commercialization  and 
meeting  agency  rad  needs.  At  the  request  of  the  Committees,  we  did  not 
obtain  information  updating  the  quality  of  sbir  research.  The  Committees 
consider  our  previous  work  in  this  area  to  have  met  their  needs.  In 
addition,  we  ^d  not  obtain  information  about  the  views  of  the  heads  of 


'Federal  Research:  Small  Busineas  Innovation  Reaeareh  Program  Shows  Succeae  But  Could  Be 
Strengthened,  Testimony  before  the  Committee  on  Small  Bu^eas,  House  Repreaentativesrbct  3, 
1981  rGAaT-RCED-92-3). 
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federal  agencies.  As  stated,  the  previous  report  presented  these  views  in 
detail. 

To  meet  the  second  objective,  we  made  use  of  the  same  questionnaire. 
Although  not  defined  in  the  law,  aggregate  commercial  trends  relate  to 
financial  activity.  For  projects  in  Phase  m,  such  financial  activity  primarily 
takes  the  form  of  sales  and  additional  fimding  for  further  technical 
development.  Throughout  the  report,  we  have  focused  on  the  level  of  total 
financial  activity  in  Phase  III  because  of  its  relation  to  aggregate 
commercial  trends.  In  addition,  we  have  focused  on  the  distribution  of  this 
activity  to  the  private  and  federal  sectors  because  of  its  relation  to  the 
goals  of  private-sector  commercialization  and  meeting  agency  rad  needs. 

If  this  activity  occurs  in  the  private  sector,  through  additional 
developmental  fundittg  provided  by  private-sector  sources  or  sales  to 
private-sector  customers,  it  can  be  related  to  the  goal  of 
commercialization.^  By  contrast,  if  it  occurs  in  a  federal  agency  through  the 
agency’s  further  developmental  funding  of  a  company’s  rad  or  purchase  of 
a  company’s  product,  it  can  be  related  to  meetmg  agency  rad  needs.  The 
detailed  information  obtained  by  the  survey  enabled  us  to  identify  such 
activity  in  both  the  private  and  federal  sectors,  relate  this  activity  to  the 
goals  of  the  program,  and  thus  determine  the  program’s  aggregate 
conunercial  trends. 

Although  the  legislation  required  us  to  evaluate  Phase  m,  a  lack  of 
program  criteria  constrained  the  evaluation.  As  a  consequence,  we  found 
that  comparisons  of  the  data  obtained  in  our  survey  were  more  useful  for 
such  evaluation. 

One  of  the  main  problems  in  evaluating  ntase  III  is  the  absence  of  formal 
criteria  by  which  to  judge  the  results,  once  they  are  determined.  Although 
SBIR  legislation  established  four  goals  for  the  program,  it  provided  no 
criteria  for  these  goals,  sba’s  policy  directive  of  1988  also  provides  no 
criteria. 

We  discussed  the  problem  of  evalxiating  sbir’s  Phase  m  results  with  sba 
officials,  who  have  also  been  reviewing  Phase  n  winners  and  their 
accomplishments  in  Phase  IB.  The  sba’s  Assistant  Administrator,  Office  of 
Innovation,  Research,  and  Technology,  said  that  difficulties  were 


^or  sales,  the  term  *the  private  sector^  includes  domestic  nonfederal  and  expc»t  maiicelB.  For 
additional  developmental  hinding,  sources  of  private«ector  activity  include  all  sources  except 
non-SBIR  federal  funds  and  related  SBIR  awarifs)  received  after  the  award.  For  example,  these 
sources  include  the  company  itself,  other  private  companies,  and  investors  in  the  Unit^  States  or 
foreign  countries. 
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experienced  in  determining  a  suitable  design  and  methodology  for  the 
conduct  of  sea’s  study  because  no  known  similar  study  had  been 
performed  in  federal  rad  procmrement 

Given  the  lack  of  criteria,  we  based  our  evaluation  mainly  on  comparisons 
of  data  provided  by  our  survey.  These  comparisons  were  a  basic  part  of 
our  mediodology.  For  exan^le,  in  analyzing  the  responses  to  the 
questionnaire,  we  compared  agencies’  project  results  to  show  how 
agencies  respond  differently  to  the  goals  of  the  program. 

On  the  basis  of  discussions  with  the  sber  Program  managers,  we  decided 
that  the  best  source  of  information  about  Phase  III  activities  would  be  the 
companies  that  had  won  Phase  n  awards.  We  sent  a  questionnaire  for  each 
of  2,090  Phase  n  awards  made  to  1,337  companies.^  'nUs  group  consisted  of 
all  the  Phase  II  awardees  fix>m  the  first  4  years — 1984  through  1987— in 
which  the  agencies  made  Phase  II  awards.  We  chose  the  earliest  recipients 
because  studies  by  experts  on  technology  development  concluded  that  5 
to  9  years  are  needed  for  a  company  to  progress  firom  a  concept  to  a 
commercial  product  We  did  not  include  Hiase  n  recipients  from  1988  or 
later  because,  in  most  cases,  they  have  not  had  sufficient  time  to  “make  or 
break”  themselves  in  Phase  m.^ 

Even  with  this  early  group  of  Phase  n  recipients,  additional  time  is 
required  for  projects  to  mature.  The  earliest  funded  projects  in  our  survey 
(those  receiving  Phase  n  awards  in  1984)  have  had  only  about  7  years  for 
development,  whereas  those  funded  in  1987  have  not  yet  reached  the 
minimum  amount  of  time  considered  necessary  for  full  development 
About  10  percent  of  the  projects  responding  to  our  survey  had  not  even 
completed  Phase  H.  Our  findings,  therefore,  represent  an  early 
interpretation  of  the  trends  in  Phase  m. 

Our  survey  included  all  of  the  Phase  II  awardees  rather  than  only  a 
selected  sample  durirrg  the  1984-87  time  frame.  'This  approach  provided 
the  most  complete  data  that  we  could  obtain  regarding  cotiunercial  trends. 
It  also  enabled  us  to  analyze  the  performance  of  the  five  agencies  with  the 
largest  sbir  Programs  and  compare  them  with  each  other. 


’Because  of  the  variety  of  names  and  addresses  a  company  may  use,  we  defined  companies  by  creating 
an  identifier  that  combined  the  company  name,  street  address,  and  sip  code.  This  procedure  led  to  the 
1,337  companies  that  we  contacted  in  our  survey. 

*In  addition,  we  did  not  include  some  companies  that  may  have  advanced  directly  from  Phase  I  into 
Phase  III,  without  receiving  a  Phase  11  award.  A  survey  of  thousands  of  Phase  I  awards  to  identify  this 
additional  Phase  III  activity  would  have  been  impractical  and,  in  our  view,  not  cost-botefidal. 
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For  the  Buise  II  recipients  in  our  survey,  we  wanted  to  determine  whether 
their  sent  projects  remained  active  after  completing  n\ase  n.  This 
represented  die  first  step  in  identifying  commercial  trends.  We  also 
wanted  to  know  the  nature  and  the  extent  of  any  further  activity.  Our 
study  focused  on  additional  developmental  funding  and  on  actual  or 
expected  sales  in  Phase  III  as  the  most  direct  measures  of  commercial 
trends.  In  our  survey,  we  defined  "sales”  to  include  all  sales  of  product(s), 
process(es),  service(s),  or  other  sales  to  federal  or  private-sector 
customers  resulting  firom  the  technology  associated  with  the  project  We 
defined  "additional  developmental  fimding”  to  include  funding  fixim 
federal  or  private-sector  sources,  from  the  companies  themselves,  or  fix>m 
other  related  sbir  awards  used  for  further  development  of  the  technology 
associated  with  the  phase  n  project 

We  developed  the  questionnaire  with  assistance  from  the  sbir  Program 
managers  at  the  five  agencies  with  the  largest  sbir  Programs  and  officials 
at  SBA.  We  pre-tested  it  with  10  companies  and  made  further  revisions 
based  on  their  suggestions.  We  mailed  the  questioimaires  in  January  1991 
and  followed  up  with  two  mailings  to  companies  that  did  not  initially 
respond.  Although  we  surveyed  2,090  projects,  202  were  e'iminated 
because  the  questionnaires  were  undeliverable  or  the  projects  were 
incorrectly  identified  as  Phase  n  awards.  This  left  1,8^  projects,  of  which 
1,457  responded,  representing  a  77-percent  response  rate.  TTus  provided 
the  most  complete  data  that  we  could  obtain  regarding  commercial  trends, 
forming  a  credible  basis  for  evaluating  the  trends  of  the  sbir  Program  in 
Phase  in. 

Throughout  this  report,  the  responses  to  our  survey  are  presented  either 
as  "actual”  or  "expected”  results  of  company  activity.  The  time  frame  for 
actual  results  extends  firom  1984,  when  agencies  made  the  first  Htase  n 
awards,  through  the  time  when  companies  submitted  their  responses.  We 
accepted  no  responses  after  July  1991,  when  we  finalized  the  findings  in 
the  questionnaires.  The  time  fi:ame  for  expected  results,  based  on 
company  estimates,  extends  fi’om  the  date  a  resptmse  was  received  (no 
later  than  the  close  of  the  survey  in  July  1991)  through  the  end  of  19^. 
Although  companies  responded  to  the  survey  as  early  as  February  and  as 
late  as  July  1991,  we  are  using  the  phrase  "as  of  July  1991”  as  an  easy 
reference  to  the  whole  set  of  1,457  responses  we  analyzed.  The  date  July 
1991  is  also  used  to  differentiate  between  "actual”  versus  "expected” 
results. 
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To  assess  the  perfonnance  of  the  sem  Program,  we  used  the  total  activity 
across  all  projects  (regardless  of  individual  project  success)  in  our 
computations.  For  example,  the  reader  should  understand  that  the  term 
"average  dollars  per  project”  (that  is,  sales  and  additional  developmental 
funding  per  project)  was  derived  by  dividing  the  total  dollars  by  the  total 
number  of  projects  responding.  As  reported  by  the  1,457  projects  (some  of 
which  were  discontinued),  the  total  sales  were  $470,533,109.  Therefore, 
the  average  sales  per  project  was  $322,947.  Had  we  calculated  averages  by 
using  only  those  projects  that  had  sales  or  had  received  additional 
developmental  fimd^  the  result  would  have  greatly  overstated  the 
averages  stated  in  this  report 

The  report  is  organized  to  reflect  three  levels  of  analysis.  Chapter  2 
discusses  the  overall  results  of  projects  responding  to  our  survey  and  thus 
summarizes  the  aggregate  commercial  trends.  Ch^ter  3  analyzes  the 
results  in  terms  of  the  individual  agencies  that  provided  the  awards,  their 
policies  regarding  commercialization,  and  key  federal  issues  relating  to 
niase  m.  Cluster  4  analyzes  the  results  in  terms  of  the  companies  that 
conducted  the  projects. 

We  conducted  our  audit  work  between  August  1990  and  August  1991  in 
accordance  with  generally  accepted  government  auditing  standards.  We 
requested  and  received  written  comments  on  our  draft  of  this  report  from 
SBA  and  the  five  nuyor  sbir  agencies — dod,  hhs,  nasa,  doe,  and  nsf.  The 
comments  from  each  of  these  agencies  except  doe  are  presented  as 
2q>pendixes.  doe's  comments  have  not  been  included  as  an  appendix 
because  they  were  focused  on  technical  matters;  however,  all  of  doe’s 
comments  have  been  incorporated  in  our  report.  A  brief  discussion  of  the 
other  agency  comments  is  given  at  the  end  of  chapter  3,  and  a  more 
detailed  response  appears  at  the  end  of  each  agency’s  letter  in  appendixes 
1  through  V.  We  also  discussed  the  report  with  usda,  doc,  DOEd,  dot,  epa, 
andNRC. 
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According  to  questionnaire  responses  involving  1,457  niase  II  projects, 

939  projects  have  remained  active  in  Phase  m  Mdiile  518  have  l^n 
discontinued.  The  nu^oiity  of  Phase  m  activity  has  occiirred  in  the  private 
sector,  indicating  that  projects  in  general  are  moving  toward  the  goal  of 
private-sector  commercialization.  As  of  July  1991,  the  ssm  Program  had 
generated  about  $1.1  billicm  in  Phase  m  sales  and  additional  funding  for 
technical  development,  with  up  to  about  $3  billion  more  expected  by  the 
end  of  1993.  Minority  and  disadvantaged  small  businesses  reported  a 
substantially  lower  level  of  Phase  m  activity.  Companies  indicated  that 
their  projects  are  emphasizing  innovation  tluough  developing  new 
technologies  rather  than  improving  or  adtqpting  already  proven 
technologies. 

This  cluq)ter  provides  an  overview  of  the  status  of  the  projects  analyzed  in 
our  survey,  their  actual  sales  and  additional  developmental  funding 
reported  as  of  July  1991,  and  the  expected  results  from  that  time  through 
the  end  of  1993  for  Riase  m.  It  emphasizes  the  relation  of  this  financial 
activity  to  increasing  private-sector  commercialization  and  meeting  agency 
needs.  It  discusses  the  projects  that  have  been  discontinued,  including 
their  accomplishments  and  the  reasons  that  they  are  no  longer  active.  It 
also  summarizes  information  relating  to  the  program  goals  of  stimulating 
innovation  and  fostering  participation  by  minority  and  disadvantaged 
small  businesses. 


Overview  of  the 
Status  of  Phase  n 
SBIR  Projects 


The  1,457  niase  II  projects  responding  to  our  survey  provided  an  overview 
of  their  status  as  of  July  1991.  Of  the  939  projects  that  remain  active,  700 
indicated  that  they  have  achieved  sales  and/or  additional  developmental 
funding  already;  238  have  not  yet  achieved  such  results  but  expect  them; 
and  1  project  has  remained  active  but  did  not  specify  whether  it  has 
achieved  or  expected  any  results.  Of  the  518  projects  that  have  been 
discontinued,  96  achieved  sales  and/or  additional  developmental  funding 
before  they  ended,  while  422  were  discontinued  with  no  Phase  IE  activity. 


Actual  and  Expected 
Sales  in  Phase  HI 


Our  definition  of  sales  attempted  to  cover  all  of  the  possible  types  of  sales 
and  customers  that  a  small  business  might  develop  in  Phase  m.  As  defined 
in  our  questionnaire,  sales  included  all  sales  of  pr^uct(s),  process(es), 
service(s),  or  other  sales  to  federal  or  private-sector  customers  resulting 
fix>m  the  technology  associated  with  the  specific  Huise  n  prqject  A  sale 
could  also  include  the  sale  of  technology  or  ri^ts,  which  was  counted  as 
part  of  the  total  sales  activity. 
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Figure  2.1  shows  the  total  sales  achieved  by  sbir  Hiase  n  projects  and  the 
distribution  of  these  sales  to  key  customers  as  of  July  1991.  Overall,  515 
projects  (or  about  a  third  of  the  projects  responding  to  our  survey) 
reported  $471  million  in  actual  sales  through  July  1991.  Customers 
purchasing  the  results  of  sbir  activity  in  phase  m  included  the  private 
sector,  export  markets,  the  mission-related  agencies  (dod  and  nasa),  other 
federal  agencies,  and  others  such  as  state  and  local  governments.  The 
information  on  the  distribution  of  sales  to  these  customers  can  be  related 
to  both  the  achievement  of  private-sector  commercialization  and  the 
meeting  of  agency  rad  needs  in  niase  m.  Combining  private-sector  with 
export  sales,  the  private  sector  emerges  as  the  nuyor  customer  by  a 
iTuirgin  of  about  2  to  1,  indicating  a  general  trend  toward  the  goal  of 
increasing  commercialization. 
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Figure  2.1:  Federal  and  Private-eector 
Salea  by  Phaee  II SBIR  Pro|ecta 
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Other  federal  markets 
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Other  markets 


Domestic  nonfederal  markets 


Export  markets 


Total  sales  for  515  of  1 ,457  projects  as  of  July  1991  were  $471  million. 


Private-sector  commercialization  includes  domestic  nonfederal  and  export  markets. 


Total  may  not  add  to  100  percent  due  to  roundmg. 


The  distribution  of  sales  by  size  provides  additional  information  about  the 
results  of  these  projects.  Table  2.1  summarizes  the  number  of  projects  in 
categories  of  total  sales  ranging  from  less  than  $100,000  to  more  than  $6 
million. 
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rabto  2.1 :  Distribution  of  Total  Sales 


Number  of  project* 

Total  sale*  per  project 

175 

Less  than  $100,000 

111 

$100,000  to  $249,999 

60 

$250,000  to  $499,999 

66 

$500,000  to  $999,999 

81 

$1,000,000  to  $4,999,999 

22 

$5,000,000  or  more 

As  shown  in  table  2.1,  a  substantial  sales  activity  resulted  from  relatively 
few  awards.  For  example,  the  highest  category  of  total  sales  ($5  million  or 
more)  accounted  for  about  $232  million  of  the  total  amoimt.  Ibe  two 
largest  individual  sales  reached  about  $25  million  each,  followed  by  one  of 
$20  million,  one  of  $17  million,  and  two  of  $15  million  each. 

These  overall  sales  results  provide  an  early  vie  w  of  commercial  trends. 
About  half  of  the  first  sales  reported  for  projects  with  sales  occurred 
within  3  years  of  the  time  of  the  survey,  as  shown  in  figure  2.2,  which 
summarizes  the  percentage  of  projects  that  made  first  sales  in  a  given  year 
from  1984  through  1991. 
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Figure  2.2:  Percerttage  of  Projects  That 
Made  First  Sales  Between  1984  and 
1991 


Actual  and  Expected 
Developmental 
Funding  in  Phase  HI 


Clwpter  2 

Reinlto  of  8BIB  Pndecta  in  Pheoe  III 


Yaar  of  firat  tala 

504  projects  reported  their  first  sale  occurred  between  1 964  and  1 99 1 . 


The  amount  of  sales  expected  between  July  1991  and  the  end  of  1993 
exceeds  the  amount  for  sales  already  reported.  In  fact,  in  addition  to  the 
$471  million  in  actual  sales,  companies  conducting  758  projects  expect  a 
further  $1.94  billion  in  sales  to  result  from  these  projects  by  the  end  of 
1993.  One  reason  for  this  larger  sales  figure  is  that  many  projects  that  have 
already  made  sales  expect  to  continue  their  sales  and  are  being  joined  by 
other  projects  that  expect  their  first  sales  to  occur  after  July  1991.  Only  43 
projects  that  had  already  achieved  sales  indicated  no  expectation  of 
continuing  sales. 


Among  the  1,457  projects,  about  half  (732)  reported  additional 
developmental  funding  that  amounted  to  $646  million  as  of  July  1991.  ‘ 
Total  additional  developmental  funding  from  private  sources  reached 
$363.8  million,  while  $282.2  million  took  the  form  of  further  federal 
funding.  Figure  2.3  summarizes  the  sources  of  these  funds  in  greater  detail. 


'Our  definition  of  additioTMi  developmental  Ainding,  as  stated  in  the  questionnaire,  included  hinds 
from  federal  or  private-sector  sources,  firom  the  individual  company  performing  the  SBIR  work,  or 
horn  other  related  SBIR  awards  used  for  further  development  of  the  technology  associated  with  the 
prqiect 
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Semlta  of  SBIR  Prqiecta  in  Pkoae  III 


Figure  2.3:  Sources  of  AddItionsI 
Developmental  Funding 
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Sourest  of  additional  dovsiopinental  funds 

Total  additional  developmental  funds  for  732  of  1,457  projects  as  of  July  1991  were  $646  million. 


As  a  supplement  to  the  $646  million  in  additional  developmental  funding, 
projects  remaining  active  expected  a  minimum  of  $335  million  and  a 
maximum  of  $1.07  billion  in  additional  developmental  funding  between  the 
time  of  the  survey  and  the  end  of  1993.  Combining  the  projects  remaining 
active  and  those  that  have  had  additional  developmental  funding  or  sales 
yields  1,034  projects.  Of  these,  719  projects  reported  that  slightly  more 
than  $2  billion  is  needed  to  realize  their  full  sales  potential. 

To  determine  the  extent  of  sbir’s  role  in  achieving  Phase  m  sales  and 
additional  developmental  funding,  we  asked  companies  to  judge  whether 
each  project  had  played  no  role  or  a  minor,  moderate,  or  in^or  role  in 
sales  and  additional  developmental  funding.  Overall,  we  found  that  the 
Phase  II  awards  played  a  moderate  to  m^yor  role  in  achieving  Phase  III 
results. 
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Discontinued  Projects 


A  total  of  518  projects  have  been  discontinued,  of  which  96  indicated  that 
funding  and/or  sales  had  occurred  but  that  the  project  subsequently  ended. 
For  another  422  projects,  funding  and/or  sales  had  not  occurred  and  were 
not  expected;  no  further  work  on  these  projects  wa*  under  way. 

Of  the  96  projects  reporting  Phase  in  activity  before  being  discontinued, 

42  projects  generated  $6.9  million  of  sales  and  70  projects  obtained  vc>6.9 
million  of  additional  developmental  funding.  Two  of  the  projects  reported 
sales  of  $1.7  million  and  $1  million;  an  additional  13  reported  sales  of  at 
least  $100,000  but  less  than  $1  million. 

Projects  were  discontinued  for  a  wide  var  •  ty  of  reasons.  The  most 
frequently  cited  reason  prized  to  be  the  insufficiency  of  additional  funding 
for  further  technical  development  About  66  percent  of  the  discontinued 
projects  identifiH  this  factor  as  playing  a  moderate  or  great  role  in  their 
discontinuatioa  *'igu*r  ”  1  shows  the  top  five  factors  in  this  regard. 
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Figure  2.4:  Factors  Playing  a  Great  or 
Moderate  Role  In  Deciding  to 
Discontinue  Projects 
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Factors 


I  [  Moderate  role 
Great  role 

Companies  assodated  with  the  518  discontinued  projects  were  asked  to  rate  separately  1 1  fectors 
for  their  role  in  the  decision  to  discontinue  the  projects.  The  figure  shows  the  5  most  fre^endy  cited 
factors. 


Among  the  518  projects  that  were  discontinued,  36  percent  were 
discontinued  during  or  at  the  end  of  Hiase  II,  37  percent  within  1  year 
after  completing  Phase  n,  and  20  percent  more  than  1  year  later.  Eight 
percent  did  not  indicate  when  the  company  ended  the  project 
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Projects  Stress 
Innovation,  but 
Minority  Businesses 
Report  Lower  Phase 
in  Activity 

Projects  Stress  Innovation  in  general,  projects  have  emphasized  developing  a  new  technology  rather 

than  improving  or  adapting  an  already  proven  technology.  Our  survey 
indicated  that  about  73  percent  of  the  projects  would  probably  or 
definitely  not  have  been  undertaken  without  assistance  from  sbir.  Among 
the  1,457  projects  responding  to  our  survey,  293  projects  reported 
receiving  539  patents.^  In  addition,  as  noted  earlier,  about  18  percent  of  the 
discontinued  projects  reported  that  a  high  level  of  risk  and  innovation 
reduced  their  sales  potential,  and  this  reason  was  cited  as  playing  a 
moderate  or  great  role  in  discontinuing  the  project. 

Companies  commented  on  the  importance  of  the  sbk  Program  as  a  source 
of  innovation.  For  example,  according  to  the  president  of  Creative  Optics, 
Inc.,  of  Bedford,  Massachusetts,  the  sbk  Program  has  permitted  his 
company  to  compete  on  innovation,  which  he  describes  as  a  difficult 
commodity  to  price,  rather  than  on  price  alone.  He  added  that,  without  the 
SBIR  bidding  process,  federal  agencies  would  have  to  request  and  specify  in 
detail  desired  results  without  knowing  the  optimum  path  to  the  results.  He 
points  out  that  this  approach  is  completely  unlike  traditional  bidding 
processes  for  the  government,  which  are  more  suited  to  building  aircraft 
or  bridges  of  known  size  and  type.  Thus,  according  to  the  president  of 
Creative  Optics,  Inc.,  the  sbir  process  can  be  described  as  "entrepreneurial 
bidding”  because  it  allows  the  government  to  specify  the  desired  end 
product  in  concept  form  while  aUowing  the  bidding  companies  to  bid  as 
entrepreneurs  on  what  they  think  is  the  best  way  to  achieve  the  goal. 

The  president  of  Photo-Catalytics,  Inc.,  of  Boulder,  Colorado,  also 
commented  on  imiovation  in  the  sbir  Program  and  contrasted  it  with 
“conservatism”  elsewhere  in  the  private  sector.  He  sees  the  sbir  Program 
as  essential  for  allowing  a  growing  number  of  entrepreneurs  with 
innovative  ideas  to  help  test,  develop,  and  commercialize  them.  The 
private  sector,  he  says,  appears  to  be  extremely  conservative  in 
undertaking  rad  of  ideas  not  proven  commercially,  even  when  such  ideas 
have  been  successfuUy  demonstrated  in  the  laboratory. 


In  addition  to  providing  information  about  the  goals  of  commercialization 
and  meeting  agency  rad  needs,  the  survey  yielded  information  relevant  to 
the  other  two  goals  of  the  program:  stimulating  innovation  and  fostering 
participation  by  minority  and  disadvantaged  smaU  business  enterprises. 


*rhirty-two  projects  did  not  provide  infonnation  on  patents. 
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Minority  and 

Disadvantaged  Businesses 
Reported  Lower  Activity  in 
Phase  in 


Minority  and  disadvantaged  businesses  conducting  147  projects  responded 
to  the  survey,  representing  10.1  percent  of  our  response.  These  companies 
reported  sales  of  $20.9  million,  or  about  4.4  percent  of  the  sales  reported 
for  all  projects.  Thus,  the  level  of  sales  per  project  is  substantially  lower 
than  the  average  for  all  projects  responding  to  the  smvey. 


A  similar  pattern  holds  for  additional  developmental  funding,  which 
amounted  to  $43.4  million  or  6.7  percent  of  the  overall  funding  for  further 
technical  development  Sources  of  additional  developmental  funding  were 
divided  fairly  equally  among  the  private  sector  ($13.7  million),  related  sbk 
awards  ($15.4  million),  and  non-SBIR  federal  funds  ($14.3  million).  No 
project  reported  any  additional  developmental  fund^  from  Unit^  States 
venture  capital  companies. 


Regarding  the  status  of  these  projects,  some  96  (or  65  percent)  remain 
active,  while  2  percent  have  been  discontinued  after  some  Phase  m 
activity  and  33  percent  ended  with  no  Phase  HI  activity.  The  reasons  given 
for  discontinuing  projects  followed  a  pattern  generally  similar  to  those 
cited  earlier  as  playing  a  moderate  or  great  role  in  discontinuing  projects. 
InsufQcient  additional  funding  for  further  technical  development,  a 
company’s  shift  of  work  to  other  priorities,  and  small  market  demand  were 
the  three  leading  factors  cited  in  discontinuing  projects. 
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Although  many  projects  were  carried  forward  to  Phase  m,  the  sales 
averages  for  the  projects  varied  greatly  among  the  agencies.  Projects 
funded  by  hhs  and  nsf  reported  substantially  higher  sales  per  project  than 
those  funded  by  dod,  doe,  and  nasa.  The  percentage  of  private-sector 
commercialization  achieved  by  the  five  nuyor  agencies’  projects  also 
varied  widely — from  40  percent  for  dod  to  92  percent  for  hhs.  Policies 
relating  to  commercialization  also  differ  amoitg  agencies,  with  dod  placing 
greater  emphasis  on  meeting  agency  rad  needs  and  several  other  agencies 
taking  steps  to  emphasize  the  commercialization  of  their  projects’  rad. 

Three  federal  issues  should  be  addressed  to  strengthen  the  program  in 
Phase  m.  First,  federal  officials  disagree  on  the  emphasis  they  should  give 
to  private-sector  commercialization.  'This  issue  primarily  affects  dod 
because  it  has  the  largest  sbir  Program  and  emphasizes  the  program  goal 
of  meeting  its  own  rad  needs  first,  then  increasing  private-sector 
commercialization.  Second,  dod  and  nasa  officials  told  us  of  the  use  of 
incorrsistent  procurement  practices  in  requiring  competition  for  sbir 
projects  entering  Phase  ID.  Third,  companies  expres^  concern  about 
whether  the  company  or  the  agency  that  fimded  its  project  should  perform 
additional  work  after  Phase  n,  if  the  agency  wishes  to  continue  work  on 
the  technology. 


Results  of  Phase  HI 
Activity,  Including 
Commercialization, 
Vary  by  Agency 


This  section  provides  an  overview  of  the  results  achieved  by  projects  for 
each  agency.  The  data  show  the  variation  among  agencies  in  their  projects’ 
sales,  additional  developmental  funding,  and  response  to  the  goals  of 
commercialization  and  meeting  federal  agencies’  rad  needs,  .^ong  the 
five  nuqor  sbir  agencies,  hhs  achieved  the  highest  level  of  sales  per  project 
as  well  as  the  highest  percentage  of  private-sector  activity  for  sales  and 
additional  developmental  funding.  In  general,  projects  fimded  by  two  of 
the  msgor  sbir  agencies — hhs  and  nsf — reported  substantially  higher  sales 
per  project  than  the  other  nuqor  agencies,  hhs’  projects  achieved  an 
average  of  about  $677,000  and  nsf’s  average  was  $531,000  for  each  project 
responding  to  the  survey,  dod,  the  largest  sbir  agency,  achieved  a  project 
average  of  about  $285,000;  doe,  $215,000;  and  NASA,  $161,000. 

Variations  in  the  percentage  of  sales  to  the  private  sector  were  also 
evident  Figure  3.1  provides  an  overview  of  the  total  sales  for  each  of  the 
nuyor  sbir  agencies’  projects  in  terms  of  their  distribution  to  the  private 
and  federal  sectors. 
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Total  sales  for  OOD  were  $195.5  million;  for  NASA,  $36.4  million;  for  DOE,  $31 .1  million;  for  NSF, 
$58.9  million; and  for  HHS,  $127.3  million. 

The  above  totals  might  exceed  the  sum  of  individual  amounts  allocated  to  various  markets  because 
some  companies  provided  only  their  overall  sales  and  did  not  specify  the  customer(s)  for  their 
projects. 


These  results  show  the  difference  between  dod  and  the  other  four  nuyor 
SBIR  agencies  regarding  the  response  to  private-sector  commercialization 
and  meeting  agency  r&d  needs,  dod,  in  fact,  is  the  only  federal  agency 
among  the  five  largest  ones  in  the  program  whose  sent  projects  made  more 
sales  to  the  federal  government  than  to  the  private  sector  (including 
export  markets).  For  all  other  agencies,  only  16  percent  of  their  projects’ 
total  sales  were  to  the  federal  government  while  84  percent  were  to  the 
private  sector.  The  results  of  dod’s  686  projects  responding  to  our  survey 
substantially  affected  the  percentage  of  total  sent  sales  to  the  private 
sector  in  Phase  m. 
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In  greater  detail,  tables  3.1  through  3.3  show  the  sales  and  additional 
developmental  funding  activity  for  each  of  the  11  agencies.  Table  3.1 
shows  the  total  reported  sales  and  additional  developmental  fimding  for 
each  agency’s  projects  and  the  average  per  project  Projects  fimded  by  two 
of  the  nuyor  sem  agencies — ^hhs  and  nsf — ^repotted  substantially  higher 
sales  per  project  than  the  other  nu^or  agencies,  iihs’  projects  achieved  an 
average  of  $677,000  and  nsf’s  average  was  $531,000  for  each  project 
responding  to  the  survey,  dod  achieved  a  project  average  of  about 
$2^,000;  DOE,  $215,000;  and  NASA,  $161,000.  The  five  agencies  vdth  the 
larger  sbir  Programs  account  for  about  93  percent  of  the  projects 
responding  to  our  survey  and  exert  by  far  the  largest  influence  on  the 
overall  results. 


Table  3.1;  SBIR  Pha—  III  Salds  and  Additional  Ddvelopmdntal  Funding  Reportad  by  Agency  for  Phasd  II  Awards,  1984-87 


Number  of  survey  _ 

Sales 

Additional  developmental  funding 

responses 

Total  Average  per  project 

Total 

Average  per  project 

DOD 

686 

$198,482,040 

$284,959 

$217,254,552 

$316,698 

HHS 

188 

127,312,135 

677,192 

196,645,448 

1,040.667 

NASA 

226 

36,427,005 

161,181 

77,962,838 

345,056 

DOE 

145 

31,142,319 

214,775 

66,348,378 

457,561 

NSF 

111 

58,949,296 

531,075 

48,566,924 

437,540 

USDA 

30 

7,292,668 

243,089 

21,593,350 

719,778 

DOC 

5 

818,000 

163,600 

1,096,000 

219,000 

DOEd 

9 

605,696 

67,300 

3,919,452 

435.495 

DOT 

20 

4,263,950 

213,198 

2,436,950 

121,948 

ERA 

25 

3,790,000 

151,600 

9,302,000 

372.080 

NRC 

12 

4,450,000 

370,833 

155.C00 

Table  3.2  indicates  where  the  sales  occurred,  with  customers  including 
DOD,  NASA,  other  federal  agencies,  the  private  sector,  and  export  markets. 
As  stated  earlier,  the  results  vary  greatly  among  agencies  in  the  percentage 
of  private-sector  conunercialization  for  each  agency’s  projects. 
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Taw*  3.2;  SBIR  Pha—  III  SalM  to  F»dT«l  Aguctoh,  th>  Privrtd  Sdctor,  and  Export  M>rtot«  for  Ph—  H  Award*,  1984-87 
_ Fadaral  agancy _ 


DOD 

NASA 

Olhar 

Private  aaetor 

Export  markata 

TotaP 

DOD 

$96,132,827 

$16,539,244 

$3,571,202 

$59,150,907 

$18,573,570 

$195,482,040 

HHS 

949,396 

150,000 

8,978,250 

92,935,090 

22,900,803 

127,312,135 

NASA 

4,446,588 

9,004,421 

734,750 

14,148,895 

7,777,350 

35,427,005 

DOE 

2,054,706 

238,129 

5,822,001 

19,227,643 

3,799,840 

31,142,319 

NSF 

3,113,750 

3,136,250 

1,202,950 

40,107,878 

5,926,468 

58,949,296 

USDA 

0 

0 

31,000 

5,943,668 

886,000 

7,292,668 

DOC 

0 

0 

0 

558,000 

260,000 

618,000 

DOEd 

10,000 

0 

72,000 

500,651 

16,645 

605,696 

DOT 

40,000 

0 

2,975,200 

767,500 

275,000 

4,263,950 

EPA 

30,000 

0 

145,000 

3,615,000 

0 

3,790,000 

NRC 

360,400 

0 

30,000 

2,579,600 

1,480.000 

4,450,000 

■The  total  may  exceed  the  sum  of  the  individual  amounts  because  some  companies  provided  only 
their  overall  sales  and  did  not  specify  the  customer(s)  for  their  projects.  In  addition,  the  category 
called  ‘other  markets*  in  the  survey  is  not  presented  in  table  3.2.  For  the  five  major  SBIR  agencies, 
this  category  accounts  for  less  than  1  percent  of  their  total  sales.  For  the  remaining  (smaller) 
agencies,  DOC,  EPA,  and  NRC  had  zero  for  ‘other  market’  sales;  USDA  had  6  percent:  DOT  had 
5  percent;  and  DOEd,  1  percent. 


Table  3.3  shows  the  sources  of  additional  developmental  fimding  provided 
by  the  private  sector,  non-SBIR  federal  funds,  and  later  sem  awards  used 
for  fuller  development  of  a  project.  Additional  developmental  funding  for 
DOD,  NASA,  and  doe  projects  came  primarily  from  the  federal  government 
and  took  the  form  of  non-SBIR  federal  fimds  or  later  sbir  awards.  By 
contrast,  hhs  and  nsf  projects  obtained  the  nuyority  of  their  additional 
developmental  funding  from  the  private  sector.  The  considerable  amount 
of  additional  developmental  funding  attracted  by  hhs  from  the  private 
sector — ^almost  $171  million — accounts  for  almost  47  percent  of  the  total 
from  the  private  sector.  OveraU,  the  private  sector  provided  about  56 
percent  of  additional  developmental  funding. 
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Tabid  3.3:  SBIR  Pha—  Wl  Sourc—  of  Additional  Ddvelopm«ntal  Funding  for  Pha—  W  Awrdg,  19B*^7 


Agency 

Private  aeetor* 

Non-SBIR  federal  funds 

Total 

DOD 

$  83,873.259 

$62,772,045 

$70,609,248 

$217,254,552 

HHS 

170.590.581 

6.777.000 

18.277,865 

195,645.446 

NASA 

19.920.800 

19.496.531 

38.565,305 

77,982,636 

DOE 

27,510.793 

18.357,074 

20,478,509 

66,346.376 

NSF 

28.831.903 

2,740,137 

16,994,884 

48,566,924 

USDA 

21.153,350 

40,000 

400,000 

21,593,350 

DOC 

995.000 

0 

100,000 

1.095.000 

DOEd 

1.116,210 

0 

2.803.242 

3,919,452 

DOT 

410.000 

1,278.950 

750,000 

2,438,950 

ERA 

7.920.000 

300.000 

1,082.000 

9,302,000 

NRC 

1.480.000 

280.000 

100.000 

1,860,000 

•The  sources  for  "private  sector”  additional  developmental  funding  are  the  company  itself;  other 
private  company(s);  U.S.  venture  capital  institution;  foreign  venture  capital  institution;  private 
investor;  personal  funds;  state  or  local  government;  college  or  university;  and  other  sources. 


Agencies  also  varied  in  the  percentage  of  projects  that  were  discontinued 
with  no  Phase  HI  activity,  hhs’  188  projects  had  the  lowest  percentage 
among  the  five  nuyor  agencies;  38  projects  (or  20  percent)  ended  without 
further  activity  after  Phase  n.  dod’s  6^  projects  had  the  highest 
percentage;  238  projects  (or  35  percent)  were  discontinued  with  no  further 
activity.  The  percentage  of  projects  discontinued  without  Phase  III  activity 
for  NASA  was  22  percent;  for  nsf,  27  percent;  and  for  doe,  31  percent. 


Need  for  Caution  in 
Judging  Agency 
Performance 


Although  these  results  suggest  some  of  the  trends  and  differences  among 
the  agencies,  several  factors  point  to  the  need  for  caution  in  using  the 
trends  to  judge  agency  performance.  First,  as  noted  in  chapter  1,  more 
time  is  required  for  sbir  projects  to  achieve  maturity.  Future  trends  may 
vaiy  from  current  findings,  leading  to  different  results  from  those 
presented  here.  Second,  the  markets  for  sbir  projects  vary  widely  from  one 
agency  to  another.  For  example,  hhs  projects  have  access  to  a  vigorous 
biomedical  market,  whereas  many  dod  projects  may  be  limited  to 
specialized  military  appUcations.  Third,  the  amount  of  funding  per  project 
for  Phases  I  and  II  varies  among  agencies  and  may  lead  to  different  sales 
results.  Fourth,  a  high  level  of  activity  was  concentrated  in  relatively  few 
projects,  a  fact  that  exerts  a  substantial  influence  on  individual  agency 
performance.  According  to  our  survey,  the  five  largest  project  sales  in 
each  of  the  five  nuyor  sbir  agencies  accounted  for  a  substantial  share  of 
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the  agencies  sbir  projects’  sales,  ranging  from  37  percent  for  dod’s  projects 
to  79  percent  for  nsf’s  projects.  This  concentration  of  sales  activity  in 
relatively  few  projects — especially  nsf’s  79  percent — vindicates  that  the  use 
of  “sales  per  project”  as  a  measure  of  agency  performance  needs  to  be 
treated  with  caution.* 


Program  managers  at  four  of  the  five  m^or  sent  agencies  told  us  that  they 
are  making  efforts  to  enhance  activity  in  I^iase  m.  sbir  officials  in  OOD  are 
placing  greater  emphasis  on  meeting  agency  rm>  needs,  sbir  officials  in 
NASA,  DOE,  and  nsf  are  taking  steps  to  place  greater  emphasis  on 
private-sector  commercialization,  although  nasa  is  also  continuing  to 
stress  agency  utilization  of  sbir  r&d.  hhs’  program  manager  told  us  that  no 
particular  steps  were  being  taken,  primarily  because  of  the  high  level  of 
activity  already  being  achieved. 

These  variations  in  emphasis  parallel  the  distribution  of  sales  to  the 
private  sector  and  federal  agencies.  As  shown  earlier  in  figure  3.1,  dod  was 
the  only  mayor  sbir  agency  whose  project  sales  to  the  federal  government 
exceeded  sales  to  the  private  sector.  As  a  matter  of  policy,  dod  is  also  the 
only  mayor  agency  that  is  emphasizing  meeting  federal  r&d  needs  in 
contrast  to  private-sector  commercialization. 


DOD  Although  dod  is  the  only  one  of  the  top  five  m^or  sbir  agencies  whose  sbir 

project  sales  to  the  federal  government  exceeded  sales  to  the  private 
sector  (including  export  markets),  dod  officials  are  further  emphasizing 
the  goal  of  meeting  agency  r&d  needs.  In  particular,  the  program  managers 
for  the  Army  and  Navy  indicated  that  steps  have  been  taken  or  are  imder 
way  to  strengthen  their  sbir  Programs  by  making  them  more  responsive  to 
the  agency  mission,  which  may  further  limit  their  potential  for  application 
in  the  private  sector. 

The  Army  sbir  Program  manager  discussed  his  efforts  to  strengthen  the 
program  and  increase  the  likelihood  of  Army  activity  in  niase  III.  One  of 
the  most  important  efforts  involves  tightening  up  the  review  process  for 
selecting  topics  and  projects  included  in  the  sbir  Program,  thus  increasing 
the  relevance  of  the  sbir  Program  to  the  Army’s  mission.  For  exanqile, 


'As  an  example  of  a  project  only  now  achieving  maturity  and  accounting  for  a  large  percentage  of 
Phase  III  activity  for  an  agency’s  projects,  DOS's  SBIR  Program  manager  told  us  in  October  1991  of  a 
‘breakthrough"  by  a  1985  Pha^  II  awardee.  The  company  has  obtained  $37.3  million  in  addidonai 
developmental  funding,  consisting  of  equal  amounts  contributed  by  DOE  and  a  mqjor  corporation  for 
fbrther  development  of  a  ‘clean  coal’  technology.  This  activity  occurred  alter  the  close  of  our  survey 
and  could  not  be  included  in  our  analysis. 
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according  to  the  program  manager,  the  Army’s  Light  Experimental 
Helicopter,  a  nuyor  weapons  system,  is  generating  a  high  “market 
demand.”  If  a  con^iany  proposal  for  Hiase  n  work  can  be  related  to  this 
we£^ns  system,  ^e  program  manager  and  an  Army  review  board  for  sbir 
proposals  will  see  a  greater  chance  of  niase  m  integration  into  the 
immediate  needs  of  the  Army  and  give  the  proposal  higher  marks. 

A  second  effort  involves  a  potentially  greater  use  of  cost-sharing  for  Phase 
n  projects,  in  which  sbir  fiinds  would  be  combined  with  non-SBIR  agents 
funds.  This  i^proach,  according  to  the  program  manager,  would  increase 
the  number  of  sbir  projects  being  funded  and  encourage  greater  Phase  m 
participation  by  the  agency  because  of  the  previous  financial  commitment 
In  addition,  the  Army  program  manager  would  like  to  require  that  Hiase  n 
proposals  include  evidence  of  non-SBIR  funding  support  in  the  Army 
before  the  proposal  is  sent  forward  for  further  review. 

The  Navy  sbir  Program  manager  also  discussed  his  efforts  to  enhance  the 
Navy’s  Phase  HI  activity.  These  initiatives  primarily  center  on  the 
integration  of  the  Navy’s  sbir  Program  with  the  other  ongoing  Navy 
programs.  However,  the  Navy’s  sbir  Program  is  not  only  designed  to  tap 
the  innovative  abilities  of  small  businesses  that  are  useful  to  the  Navy;  it 
also  aims  at  providing  small  businesses  with  the  opportunity  to  develop 
concepts  and  products  that  can  help  them  grow  in  the  commercial  arena. 

To  illustrate  the  sbir  Program’s  integration  with  other  Navy  programs,  the 
program  manager  noted  several  sbir  Phase  n  contracts  in  which  non-SBIR 
funds  had  supplemented  the  contractors’  efforts.  He  noted  that  the  Navy’s 
solicitation  topics  are  generally  product-specific  and  mission-oriented  as  a 
result  of  an  earlier  policy  which  gave  the  Navy  commands  responsibility 
for  choosing  the  topics.  But  he  added  that  the  new  policy  of  integration  of 
the  SBIR  Prograikt  has  allowed  for  broader  topics  in  the  solicitation.  This 
new  policy  has  provided  the  Navy’s  sbir  Program  with  an  increase  of 
non-SBIR  funds  amounting  to  sqiproximately  $7  million  in  Phase  n  and 
more  than  $25  million  in  Phase  m  fi’om  ongoing  programs  for  fiscal  year 
1991. 

The  Navy  program  manager  also  recognized  that  the  use  of  “sole-source” 
contracts  could  increase  Phase  HI  activity.  He  noted  that  on  two  occasions 
he  discussed  the  use  of  such  contracts  with  Navy  personnel  but  indicated 
that  such  an  sqiproval  has  to  be  considered  on  a  case-by-case  basis. 
Approval  for  these  two  contracts  is  expected  in  fiscal  year  1992. 
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To  help  enhance  Phase  ED  activity,  the  Air  Force  program  manager  told  us 
that  she  has  awarded  a  contract  for  a  "Phase  D-Phase  in  Guide.”  The  guide 
will  be  slanted  more  toward  “in-house”  work  at  dod  than  toward 
private-sector  commercialization.  It  will  also  feature  examples  of  projects 
that  have  moved  successfully  from  Phase  II  into  Phase  in  work  for  dod. 


NASA  The  NASA  program  manager  told  us  that  he  is  taking  steps  to  foster  a 

greater  degree  of  private-sector  commercialization  of  nasa’s  sbir  projects. 
For  example,  in  preparing  nasa’s  1991  sent  solicitation,  he  required  that  at 
least  half  of  its  technical  subtopics  must  have  identifiable  commercial 
potential. 

The  requirement  was  addressed  to  the  nine  nasa  field  centers,  such  as  the 
Kennedy  Space  Center  and  the  Jet  Propulsion  Laboratory  (jpl),  which 
submit  the  subtopics  for  the  program  manager’s  review,  approval,  and 
inclusion  in  the  solicitation.  Each  center  was  expected  to  comply  with  the 
new  policy.  As  an  example,  the  program  manager  noted  that  jpl  submitted 
24  proposed  subtopics;  1  of  these  subtopics  addressed  “High  Performance 
Autonomous  Guidance  and  Control  Systems”  for  spacecraft.  The 
commercial  potential  in  this  area,  according  to  jpl,  concerned  the 
“stability,  cost,  and  performance  of  commercial  satellites.” 

The  program  manlier  also  required  that  at  least  half  of  all  Phase  I  nasa 
awards  have  a  clear  indication  of  a  significant  commercial  £q)plication.  He 
said  that,  although  he  had  never  made  this  a  criterion  for  the  program  in 
the  past,  he  included  it  as  a  basis  for  selecting  projects  in  November  1991. 

As  a  further  example  of  efforts  to  enhance  Phase  m  activity,  the  program 
manager  published  a  nasa  sbir  Product  Catalog  1990,  which  presented 
information  on  products  developed  by  sbir  contractors.  The  catalog 
featured  those  products  that  the  contractors  wished  to  exhibit  at 
Technology  2000,  a  NASA-sponsored  technology  transfer  conference  held  in 
Washington,  D.C.,  in  November  1990.  'The  catalog  wiU  be  updated  as 
additional  products  of  nasa’s  sbir  Program  are  identified. 


DOE  To  enhance  private-sector  commercialization,  doe  has  sponsored  a 

Commercialization  Assistance  Project  for  its  Phase  II  awardees  for  the 
past  3  years  (1989-91).  'This  three-stage  project  has  been  conducted  by 
Dawnbreaker,  a  private  firm  from  Rochester,  New  York,  for  the  past  2 
years.  In  the  first  stage,  the  companies  were  provided  with  weekly 
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instructions  and  individual  advice  and  counsel,  over  a  4-month  period,  in 
the  preparation  of  a  business  plan  for  potential  sponsors.  The  second 
stage  consisted  of  intensive  assistance  in  putting  together  clear  and 
concise  visual  materials  describing  a  business  opportunity  that  could  be 
presented  in  20  minutes  to  potential  ;q[>onsors.  In  the  final  stage,  about  25 
companies  made  individual  presentations  to  about  30  decision  makers 
from  large  corporations  and  venture  capital  firms  in  an  effort  to  interest 
them  in  either  joint  ventures,  licensing,  venture  capital  investments,  or 
other  teaming  arrangements.  One-on-one  sessions  between  the  SBm 
awardees  and  the  potential  sponsors  were  also  held.  The  sponsors 
included  DuPont,  General  Dynamics,  and  Westinghouse  Ellectric. 

As  a  result  of  the  1990  project,  several  companies  received  substantial 
Phase  in  funding  for  their  work.  One  company  obtained  more  than 
$500,000  to  continue  its  project  in  particle  accelerator  technology.  The  doe 
program  manager  expects  this  year’s  Commercialization  Assistance 
Project  to  be  even  more  successful  because  of  the  many  improvements 
made  this  year. 

All  of  the  companies  that  participated  in  the  project  over  the  past  2  years, 
according  to  the  dob  program  manager,  have  developed  skills  in  business 
plan  development.  He  said  that  these  skills  wifi  be  veiy  useful  in  pursuing 
other  commercial  opportunities,  including  future  sbir  projects  from  any 
federal  agency.  He  added  that  both  the  sbir  awardees  and  the  potential 
sponsors  felt  the  project  was  very  worthwhile. 

To  increase  the  number  of  sbir  awards  that  have  commercial  potential,  in 
1986  DOE  changed  the  proposal  evaluation  criterion  on  “anticipated 
benefits  of  the  proposed  research”  to  favor  projects  with  potential  to 
attract  further  funding  for  product  or  process  development  after  the  sbir 
support  expires. 

Since  1988  doe  has  sent  its  sbir  Commercialization  Manual  to  all  Phase  I 
awardees.  The  manual  gives  comprehensive  instructions  and  suggestions 
for  obtaining  Phase  III  funding.  As  part  of  this  year’s  Commercialization 
Assistance  Project,  doe  has  distributed  the  document  “Business  Planning 
for  Scientists  and  Engineers”  to  its  Phase  n  awardees.  The  document 
describes  the  process  of  developing  a  business  plan,  from  which  a  clear 
summary  of  a  business  opportunity  can  be  presented  to  potential  fimding 
sources. 
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NSF  As  an  important  part  of  agency  efforts  to  enhance  private-  sector 

commercialization,  one  nsf  sbir  Program  nuinager  noted  nsf’s  policy  of 
placing  stiong  emphasis  on  a  follow-on  funding  commitment  for  potential 
Phase  n  awardees.^  He  said  that  potential  awardees  have  to  be  encouraged 
as  hard  about  the  commercial  applications  as  about  the  research. 

Indicative  of  the  emphasis  on  this  funding  commitment,  nsf  rates  each  of 
the  projects  on  the  quality  of  the  support  expected  for  it  in  Phase  ID.  nsf 
has  also  developed  formal  guidelines  and  documents  a  company  can 
consider  when  developing  requests  for  follow-on  funding  commitments. 

In  some  cases,  where  the  project  has  seemed  difficult  to  commercialize 
and  the  principal  investigator  has  doubted  that  an  immediate  user  could  be 
found,  the  program  manager  has  discussed  the  possible  applications  and 
encouraged  the  project  leader  to  contact  relevant  companies.  For 
example,  one  project  involved  sophisticated  mathematics  relating  to  slight 
movements  of  the  earth’s  crust;  the  firm  found  that  oil  companies  could 
use  the  mathematics  in  exploring  for  oil  and  received  a  total  of  $430,000  in 
conunitments  from  a  combination  of  oil,  instrument,  and  computer 
companies. 

The  program  managers  discussed  more  than  50  other  examples  of  funding 
commitments  that  specified  the  amounts  (ranging  into  seven  figures), 
most  with  pledges  contingent  upon  the  successful  completion  of  Phase  H. 
In  other  cases,  commitments  led  later  to  the  larger  business  acquiring  the 
small  business.  For  example,  one  small  business  developed  a  special 
laser-related  process  and  then  obtained  a  $500,000  commitment  fi-om  a 
larger  company  to  market  it;  the  new  partner  eventually  bought  out  the 
inventor. 

In  response  to  concerns  about  the  lack  of  credibility  regarding  follow-on 
funding  commitments,  the  nsf  position  is  that  the  follow-on  funding 
commitments  are  heavily  weighted  in  the  Phase  II  award  process. 
Therefore,  such  commitments  are  carefully  reviewed  and  evaluated.  More 
than  90  percent  of  all  Phase  n  awardees  have  obtained  satisfactory 
follow-on  funding  commitments. 


SBIR  legislation  provides  that  in  a  Phase  II  competition,  where  two  or  more  proposals  are 
evaluated  as  being  of  approximately  equal  scientific  and  technical  merit  and  feasibility,  special 
consideration  shall  be  given  to  those  proposals  that  have  demonstrated  third-phase,  nonfederal  capital 
commitments. 
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HHS  Because  one  component  of  hhs,  the  National  Institutes  of  Health  (nih),  has 

accounted  for  more  than  90  percent  of  all  hhs  sbir  awards,  we  talked 
primarily  with  nih’s  sbir  Program  manager  about  the  sbir  Program 
activities  within  hhs.  nih's  program  manager  said  that  no  specific  efforts  or 
program  revisions  are  being  made  within  nih  to  enhance  activity  in  Phase 
m.  According  to  nih’s  program  manager,  the  agency’s  sbir  awardees  have 
achieved  a  high  level  of  activity  in  Phase  in  already,  and  additional  agency 
efforts  are  not  being  considered  at  this  time.  The  program  manager  noted 
that  biomedical  rad  lendf  itself  easily  to  the  development  of  products, 
such  as  new  drugs,  vaccines,  and  diagnostic  tools,  with  commercial 
potential.  In  addition,  since  the  companies  know  that  there  is  little 
likelihood  that  nih  will  award  Phase  in  contracts,  they  are  compelled  to 
think  in  commercial  terms  from  the  start.  'The  nih  program  manager  said 
that,  in  contrast  to  dod,  her  agency  places  greater  emphasis  on 
private-sector  commercialization.  Thus,  in  general,  the  nih  sbir  Program 
starts  with  assumptions  that  differ  greatly  from  those  of  dod. 

nih’s  program  manager  stated  that  the  nih  grants  solicitation  topics  are 
very  broad.  In  fact,  nih’s  sbir  grants  program  allows  companies  to  propose 
whatever  topics  they  want  to  pursue,  subject  only  to  the  requirement  that 
they  be  in  line  with  nih’s  mission.^  The  program  manager  noted  that,  at  the 
end  of  each  topic  subsection,  the  solicitation  states  that  companies  are 
free  to  propose  any  project  they  would  like  to  develop.  This,  in  fact, 
encourages  small  Winesses  to  propose  research  that,  in  their  opinion,  is 
likely  to  have  high  commercial  potential. 

In  selecting  proposals  for  sbir  awards,  the  program  manager  stated  that 
scientific  and  technical  merit  is  the  nuqor  criterion,  nih  had  used 
commercial  potential  as  a  factor  during  the  first  several  years  of  the 
program  but  eliminated  it  because  the  scientists  who  reviewed  the 
proposals  were  more  adept  at  assessing  scientific  than  commercial  merit 
At  present,  the  reviewers  provide  only  their  opinion  on  commercial 
potential,  but  it  does  not  affect  the  score  that  is  assigned  to  the  proposal. 


commenting  on  the  draft  report,  HHS  noted  that  this  is  true  only  of  its  grants  program,  which 
accounts  for  about  86  percent  of  its  SBIR  activity.  The  research  topics  in  its  contracts  program  are 
more  defined  and  more  restricted  in  scope. 
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Issues  That  Should  Be 
Addressed  to 
Strengthen  Phase  in 
Activity 


Several  issues  should  be  addressed  to  strengthen  Phase  m  activity. 
Federal  officials  differ  in  their  views  about  the  emphasis  to  be  given  to 
private-sector  commercialization.  They  also  use  inconsistent  practices  in 
requiring  competition  for  projects  entering  Phase  in.  Disagreement  or 
sehous  conflict  has  occurred  regarding  when  it  may  be  appropriate  for  the 
federal  agency  to  enter  into  a  Phase  in  award  if  the  agency  plans  to 
perform  additional  work  on  a  concept  developed  under  previous  SBOt 
awards. 


Differing  Agency  Emphasis 
on  Private-sector 
Commercialization 


Agency  officials  disagree  about  the  degree  of  emphasis  they  should  place 
on  increasing  private-sector  commercialization.  Program  managers  at  nsf 
and  DOE,  for  example,  supported  the  view  that  the  success — and 
future — of  the  program  depend  primarily  on  private-sector 
conunercialization. 


NASA’s  program  manager  stated  his  uncertainty  about  the  emphasis  on 
program  goals,  e^iecially  private-sector  commercialization,  but  indicated 
that  the  program  seemed  to  be  moving  toward  a  greater  role  for 
commercialization.  He  told  us  that  he  was  a4justing  the  nasa  program  in 
this  direction. 


However,  the  dod  sbir  coordinator,  who  coordinates  the  sbir  programs  in 
DOd’s  agencies,  stressed  the  need  for  more  effective  internal  use  of  the  r&D 
and  viewed  private^ector  commercialization  as  the  responsibility  of  the 
companies,  not  the  dod  agencies.  The  coordinator  told  us  that  he  does  not 
believe  dod  should  be  in  the  business  of  trying  to  foster  commercialization 
through  emphasis  on  commercial  use  rather  than  agency  r&d  needs. 

DOD’s  Role  in  Private-sector  Because  dod  provides  by  far  the  largest  amount  of  sbir  funds  of  any 

Commercialization  agency  in  the  sbir  Program,  its  lower  percentage  in  private-  sector  sales 

than  the  other  four  major  sbir  agencies  raises  an  issue  about  its  emphasis 
on  meeting  agency  rad  needs  rather  than  private-sector 
commercialization.  The  issue  divides  into  two  questions:  (1)  Should  dod 
place  greater  emphasis  than  at  present  on  achieving  private-sector  sales? 
(2)  If  so,  what  can  dod  do  to  foster  greater  commercialization? 

The  first  question  raises  a  fundamental  policy  issue  for  the  sbir  Program. 
In  addressing  it,  several  factors  should  be  taken  into  consideration.  F^rst, 
according  to  our  survey,  about  40  percent  of  sales  by  dod  projects 
occurred  in  the  private  sector.  Given  the  absence  of  criteria  for  evaluating 
the  achievement  of  program  goals,  we  cannot  determine  whether  this  40 
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percent  represents  an  adequate  response  to  the  goal  of  commercialization. 
As  a  ratio  of  total  sales  for  dod  projects,  however,  it  represents  a 
substantial  portion  of  the  overall  activity  of  dod  projects  in  Phase  IH 

Second,  consideration  of  a  policy  to  place  greater  emphasis  on 
commercializing  dod  projects  should  take  into  account  the  ability  to 
evaluate  private-sector  potential.  As  noted  earlier  in  this  chapter,  the  most 
commercially  “successM”  agency,  hhs,  has  discontinued  its  earlier  policy 
of  analyzing  proposals  for  commercial  potential,  in  part  because  its 
reviewers  were  better  able  to  evaluate  technical  merit  than  commercial 
promise.  An  emphasis  on  greater  conunercialization  for  dod  projects 
would  mean  that  reviewers  of  proposals  must  evaluate  not  only  the 
anticipated  benefits  of  the  rad  to  dod  and  technical  merit,  as  required  at 
present,  but  private-sector  potential  as  well. 

Third,  such  a  policy  to  emphasize  commercialization  should  take  into 
accoimt  the  stron^y  stated  position  of  dod's  sbir  officials  that  the  sem 
Program  must  first  meet  the  rad  needs  of  dod  and  its  basic  mission  of 
national  defense.  In  this  respect,  private-sector  commercialization  should 
complement  the  primary  agency  mission. 

If  greater  emphasis  is  to  be  given  to  private-sector  commercialization,  the 
question  of  what  more  dod  can  do  should  be  addressed.  One  approach  is 
to  examine  those  dod  projects  that  demonstrated  a  “dual-use”  potential, 
that  is,  they  achieved  substantial  sales  to  both  dod  and  to  the  private 
sector.  In  this  regard,  nine  dod  projects  in  our  survey  showed  total  sales  of 
$500,000  or  more  to  both  dod  and  the  private  sector.  We  talked  with  senior 
company  officials  about  two  of  these  nine  projects. 

The  chairman  and  chief  executive  officer,  II-VI  Incorporated,  in 
Saxonburg,  Pennsylvania,  discussed  with  us  the  dual-use  potential  of  his 
company's  project,  which  achieved  $15  million  in  sales  to  dod  and  the 
private  sector.  He  attributed  the  project’s  flexibility  to  its  “process” 
orientation  and  its  role  as  a  generic  technology.  According  to  the 
chairman,  the  technology  involves  an  improvement  in  manufacturing 
processes  for  producing  optical  coatings  used  with  high-energy  lasers. 
Such  lasers  eat  away  at  flaws  in  the  coatings  of  lenses  and  mirrors, 
reducing  the  quality  and  reliability  of  laser  systems.  As  a  result  of  the 
Phase  n  award  sponsored  by  the  Navy,  II-VI  Incorporated  was  able  to 
characterize  and  measiu^  these  defects,  build  an  entirely  new 
manufacturing  facility  with  $1.25  million  of  its  own  money,  and  institute 
process  controls  minimizing  such  defects. 


Page  42 


GACVBCED-92-S7  Small  BnaloeM  Luravatioa  Beaeareh 


Chapters 

Federal  Agency  Performance  and  laanes  in 
Phaaem 


The  improvements  in  the  manufacturing  process  and  the  nuyor  role  of 
lasers  in  high  technology  gave  the  project  a  great  deal  of  flexibility  for 
meeting  both  military  and  civilian  needs.  Of  the  $15  million  in  total  sales, 
14  percent  went  to  the  federal  government  and  86  percent  to  the  private 
sector.  Of  the  $13  million  in  nonfederal  sales,  about  $7  million  went  to  the 
private  sector  and  $6  million  to  export  sales. 

The  chairman  told  us  that  additional  opportunities  exist  for  developing 
dual-use  technologies.  He  also  noted  that  dod’s  solicitation  for  sbir 
proposals  includes  a  requirement  for  companies  to  identify  potential 
commercial  spin-ofls.  According  to  the  chairman,  if  dod  wants  to  increase 
the  role  of  such  dual-use  technologies,  it  needs  to  make  clear  in  the 
solicitation  that  commercial  potential  will  be  given  somewhat  greater 
weight  than  at  present. 

As  another  example  of  dual-use  technology,  a  project  conducted  by 
Integrated  Systems  of  Santa  Clara,  California,  achieved  about  $10  million 
in  sales.  The  project  involved  development  of  software  for  a  robot  to  load 
munitions.  Despite  the  project’s  narrow  focus,  the  core  technology 
possessed  a  great  deal  of  flexibility  in  its  £q>plications.  The  vice  president 
of  the  company  told  us  that  the  generic  technology  was  equally  ad£q)table 
to  robots  and  automobiles;  the  controls  needed  to  enable  a  robot  to  load 
munitions  and  a  car  to  respond  to  road  conditions  have  important  features 
in  common.  The  success  of  the  dod  project  led  to  spin-offs  in  the 
automobile  industry  and  about  $5  million  in  sales  to  this  sector. 

In  general,  given  the  disagreements  among  agencies  about  the  need  for 
emphasis  on  private-sector  commercialization,  clarification  of  this  issue 
would  be  helpful.  Such  a  clarification  would  primarily  affect  dod’s  sbir 
Program.  Several  factors — dod  projects  achieving  40  percent  of  their  sales 
in  the  private  sector,  the  difficulty  of  evaluating  commercial  potential,  and 
the  strongly  stated  views  of  dod  sbk  officials  about  the  goal  of  meeting 
agency  rad  needs — should  be  taken  into  account  if  further  consideration 
is  given  to  increasing  the  emphasis  on  commercialization.  A  greater 
emphasis  on  dual-use  technologies  might  provide  one  means  of  meeting 
agency  rad  needs  and  fostering  private-sector  conunercialization  as  well. 


Inconsistent  Practices  in  One  of  the  features  of  the  sbir  Program,  as  identified  in  the  legislation 
Requiring  Competition  establishing  the  program,  is  the  streamlined  solicitation  procedures  for 

Phases  I  and  II.  Companies  submit  a  brief  proposal  (of  no  more  than  25 
pages),  which  agencies  evaluate  in  competition  with  other  sbk  proposals. 
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Those  proposals  selected  for  Phase  I  and  n  awards  receive  sbk  funding 
without  further  competition.  This  process,  however,  tends  to  break  down 
in  Phase  in  because  of  inconsistent  practices  in  requiring  competition. 

DOD  and  NASA  ofBcials  have  expressed  a  need  to  clarify  the  contractual 
procedures  that  should  be  followed  when  entering  into  a  follow-on 
non-SBIR-fimded  production  contract  under  Phase  m.  Specifically,  these 
officials  are  unsure  how  the  competition  requirements  of  the  Competitirm 
in  Contracting  Act  of  1984,  as  amended  (acA),  supply  to  such  contracts. 

CICA  requires  that  executive  agencies  conducting  a  procurement  for  goods 
and  services  must  obtain  “full  and  open  competition”  and  use  the 
“competitive  procedures” — or  combination  of  competitive 
procedures — ^that  are  best  suited  under  the  circumstances  of  the 
procurement.  The  term  “full  and  open  competition”  means  that  all 
responsible  sources  are  permitted  to  submit  sealed  bids  or  competitive 
proposals  on  the  procm^ment  “Competitive  procedures”  are  defined 
under  cica  to  mean  procedures  under  which  an  executive  agency  enters 
into  a  contract  pursuant  to  full  and  open  competition.  Under  acA, 
“competitive  procedures”  include 

...  a  competitive  selection  of  research  proposals  resulting  fiom  a  general 
solicitation  and  peer  review  or  scientific  review  (as  iq>propriate)  solicited 
pursuant  to  [the  SBIR  program].  [41  U.S.C.  §  269(b)(6).] 

However,  cica  also  provides  seven  general  exceptions  to  the  requirement 
of  full  and  open  competition  and  use  of  competitive  procedures.  These 
include  procurement  where  the  property  or  services  needed  by  the 
executive  agency  are  available  firom  only  one  source  and  no  other  type  of 
property  or  service  will  satisfy  the  agency’s  needs  or  ^diere  a  statute 
expressly  author!^  or  requires  that  the  procurement  be  made  fi:x>m  a 
specified  source.  In  most  circumstances,  a  contracting  officer  must  justify 
the  use  of  a  noncompetitive  procedive  in  writing  and  certify  the  accuracy 
and  completeness  of  the  justification.  In  addition,  the  justification  must 
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generally  be  approved  at  successively  higher  levels,  depending  on  the 
contract  amount.^ 

There  is  no  question  that  the  evaluation  of  research  proposals  under 
Phases  I  and  n  is  a  competitive  procedure  that  meets  the  requirements  of 
acA.  Phase  m,  however,  is  very  different  from  the  earlier  phases.  The 
focus  of  Phase  III  is  on  the  commercial  jqiplication  of  the  research  or  rad 
conducted  in  the  earlier  phases.  Funding  for  the  product  and  processes 
being  purchased  for  use  by  the  government  is  through  non-SBIR  sources. 
Thus,  it  is  unclear  how  acA  sqiplies  to  Hiase  m. 

As  a  result,  differing  interpretations  of  the  applicable  law  have  emerged. 
One  view  is  that  since  Phase  m,  unlike  Fliases  I  and  n,  is  a  procurement 
for  products  intended  for  government  use  and  funded  outside  the  sbir 
Program,  the  competition  requirements  of  acA  must  apply.  Under  this 
interpretation,  competition  is  required  unless  the  proposed  Hiase  HI 
award  fits  within  one  of  cica’s  recognized  exceptions  to  the  competition 
requirements.  The  other  view  is  that  Phase  in  is  an  integral  part  of  the  sem 
Program  and  that  sufficient  competition  has  occurred  in  the  previous 
phases  to  satisfy  acA  competition  requirements. 

Because  of  this  uncertainty,  federal  agencies  have  not  developed  a 
uniform  jqiproach  to  contracting  under  Hiase  m.  Some  contracting 
officers  require  full  and  open  competition  in  all  cases;  others  permit  a 
sole-source  award,  but  only  if  it  can  be  justified;  still  others  enter  into 
Phase  m  contracts  without  requiring  competition  or  justification. 
According  to  some  program  managers  and  contracting  officers,  the  current 
uncertainties  about  the  relationship  between  Phase  m  and  cica  have 
resulted  in  a  tendency  by  some  contracting  officers  to  remain  within  Phase 
II  instead  of  moving  forward  to  Phase  HI.  In  other  words,  contracting 
officers  ara  modifying  or  extending  Phase  n  or  ending  the  sem  project  at 
Phase  II  instead  of  attempting  to  contract  under  Phase  III. 


^Under  CICA  the  justilication  and  approval  requirementa  are  not  required 

(A)  when  a  statute  expressly  requires  that  the  procurement  be  made  from  a  specified  source, 

(B)  when  the  agency’s  need  is  for  a  brand-name  commercial  item  for  authorized  resale; 

(C)  in  the  case  of  a  proctirement  conducted  under  subsection  (c)(7)  (where  the  head  of  an  agency 
determines  that  it  Is  in  the  public  interest  to  conduct  a  noncompetitive  procurement  and  notifies 
Congress);  or 

(D)  in  the  case  of  a  procurement  conducted  under  the  Wagner-O'Day  Act  (41  U.S.C.  IS  46  etseq.)  or 
section  §  637(a)  of ‘Title  16.  (S  8(a)  of  the  Small  Business  Act). 

41  U.S.C.  §  263(0(2). 
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Some  of  the  program  managers  and  contracting  ofBcers  support  an 
amendment  to  acA  that  would  exempt  Hiase  m  awards  from  the 
justification  and  approval  requirements  that  acA  provides  for 
procurements  conducted  under  section  637(a)  of  title  15.  Others  favor  the 
view  that  Phase  in  is  an  integral  part  of  the  sbir  Program  and  that 
sufficient  competition  has  occurred  in  the  eariier  phases  to  satisfy  acA 
requirements. 

Since  the  sba  Administrator  issues  policy  directives  on  the  general  conduct 
of  the  SBIR  Program,  we  requested  and  received  sba’s  views  on  this  matter.^ 
In  sba’s  view,  a  Riase  m  award  may  be  made  without  competition,  sba 
states  that  the  sbir  Program  is  based  upon  the  assumption  that  the  same 
SBIR  firm  would  advance  through  Phase  I  to  F^iase  n  and  through  I%ase  m. 
sba  states: 

Congress  would  not  have  associated  the  commercialization  of  the 
products  or  processes  developed  in  Phases  I  and  n  of  the  sbir  Program 
unless  Congress  intended  there  to  be  a  continuation  by  the  same  small 
business  in  the  production  stage.  In  other  words,  if  Congress  had  intended 
there  to  be  open  competition  among  small  businesses  in  what  is  now 
Phase  m,  it  could  have  accomplished  that  by  not  having  a  Biase  m. 

SBA  offers  two  rationales  for  permitting  Phase  in  awards  without 
competition.  First,  sba  contends  that  competition  has  already  occurred  in 
Friases  I  and  11  of  the  program  that  would  satisfy  acA.  sba  states  that 
sqiproximately  22,000  proposals  are  submitted  annually  under  Riase  I; 
only  about  2,000  sbir  Phase  I  awards  are  made.  Of  these,  only  about  40  to 
45  percent  receive  Phase  n  awards.  Second,  sba  states  that  an  argument 
could  be  made  that  a  sole-source  sbir  F^iase  ni  award  is  exempt  from  the 
competition  requirements  of  acA  as  a  procurement  otherwise  authorized 
by  law.  According  to  SBA,*the  sbir  legislation  can  be  read  to  authorize 
noncompetitive  sbir  Phase  in  awards. 

Although  SBA  is  comfortable  with  its  interpretation,  it  acknowledges  that 
the  possibility  exists  "that  applicable  law  could  be  read  otherwise.” 
Therefore,  sba  believes  that  a  clear,  unequivocal  amendment  to  the  sbir 
legislation  and/or  cica  would  be  beneficial. 

In  general,  federal  officials  support  the  view  that  the  competition 
requirements  of  acA  should  not  ^ply  to  Phase  m,  in  that  these 


"Letter  fiT>m  Martin  D.  Teckler,  SBA’a  Acting  General  Counael,  to  Martin  E.  Sloane,  GAO  Aaaiatant 
General  Counael  (June  10, 1991). 
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requirements  have  already  been  met  in  the  earlier  phases.  However,  most 
agree  that  the  law  is  not  clear  on  this  point  and  suggest  that  a  clarification 
of  the  law  would  be  helpfiil.  We  agree  that  a  clarification  would  be 
beneficial  to  achieve  uniformily  in  contract  practices. 


Although  many  companies  indicated  important  benefits  obtained  fix>m 
participating  in  sbir,  a  few  companies  told  us  about  difficulties  that  they 
encountered.  One  of  these  difficulties  that  related  directly  to  our  review 
involved  the  issue  of  when  it  may  be  sqipropriate  for  an  ageiuy  to  enter 
into  a  Hiase  in  award  if  it  decides  to  continue  working  on  a  concept 
developed  under  previous  sent  awards.  This  question  has  arisen  in  at  least 
two  cases  and  has  led  to  serious  disagreement  between  the  company  and 
the  agency  in  one  of  them.  In  this  case,  the  company  expects  to  lose  a 
contract  for  about  $10  million  because  a  Navy  laboratory  has  continued  to 
work  on  its  own  with  the  company’s  SBiR-developed  technology  after  the 
end  of  Phase  n  funding.  In  addition,  senior  officials  at  several  other 
companies,  including  three  companies  with  numerous  sbir  awards,  told  us 
that  they  had  encountered  competition  with  federal  laboratories  in  their 
SBiR-related  activities. 

The  issue  has  led  to  serious  disagreement  in  at  least  one  case  concerning 
Humbug  Mountain  Research  Laboratory  (hmrl)  in  Duarte,  California,  hmrl 
received  a  Phase  11  award  fi’om  the  Naval  Air  Engineering  Center  (naec)  in 
Lakehurst,  New  Jersey,  for  the  development  of  a  new  landing  system 
aboard  aircraft  carriers.  The  Laser  Centerline  Localizer  (lcl)  uses  a  series 
of  low-power  but  highly  visible  laser  beams  to  guide  the  {q)proach  of 
aircraft  In  addition,  hmrl  invented  a  Laser  Glideslope  Indicator  (lgi)  for 
helping  pilots  to  descend  safely;  the  lgi  received  a  Phase  I  award  fixrm 
NAEC.  Both  technologies  have  become  the  focus  of  a  controversy  between 
HMRL  and  the  Navy  about  who  should  perform  additional  work  in  Phase  ID. 

The  Navy  has  taken  several  steps  to  prove  the  value  of  these  technologies. 
The  Naval  Air  Test  Center,  which  is  the  testing  component  for  the  Naval 
Air  Command  under  which  the  work  at  naec  was  done,  subjected  both 
technologies  to  formal  competition  in  a  “fly-ofT  against  other  landing 
systems.  The  Navy  identified  the  lcl  and  lgi  as  the  “systems  of  choice"  in 
announcing  the  results  of  the  competition.  The  Navy  technical  maruiger  for 
the  HMRL  work  told  us  that  the  Navy  intends  to  make  full  use  of  the 
systems  on  each  of  its  12  aircraft  carriers  and  will  also  install  them  on  a 
13th  carrier  slated  for  construction. 
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As  a  result  of  its  accomplishments  in  Phases  I  and  n,  hmrl  fully  expected 
to  continue  working  with  the  Navy  under  a  Phase  in  award.  However, 

HMRL  learned  in  early  1991  that  the  Navy  had  decided  to  develop  the 
systems  further  on  its  own,  using  naec  facilities  rather  than  contractual 
support  from  hmrl.  Subsequently,  hmrl  protested  to  the  Navy  that  its 
decision  runs  counter  to  the  intent  of  the  Congress  in  establishing  the  sbir 
Program,  hmrl  believes  that  the  program  was  designed  to  foster  the 
growth  of  innovative  small  businesses,  not  to  provide  a  mechanism  for  the 
government  to  take  over  the  best  ideas  from  small  businesses. 

In  response  to  letteis  from  Senator  Slade  Gorton,  the  Assistant  Secretary 
of  the  Navy  for  Research,  Development,  and  Acquisition  discussed  the 
Navy  decision  in  a  letter  dated  June  4, 1991.  The  Assistant  Secretary  stated 
that  hmrl’s  desire  to  install  a  prototype  lcl  system  on  an  aircraft  carrier 
£q)pears  well  intentioned  and  merits  serious  consideration.  He  has 
requested  a  review  of  the  feasibility  of  this  proposal.  Further,  the  Assistant 
Secretary  provided  his  general  views  on  the  sbir  Program.  He  stated  that,  if 
an  SBIR  contract  leads  to  a  concept  which  the  Navy  wants  to  pursue,  he 
would  expect  the  Navy  generally  to  involve  the  contractor  in  any  further 
development  or  production  efforts  when  it  is  practical  and  legally 
permissible  to  do  so.  He  indicated  that  he  has  also  asked  for  a  review  of 
the  implications  of  naec’s  decision  on  the  Navy’s  relation  with  small 
business. 

In  a  meeting  with  hmrl  in  July  1991,  hmrl’s  senior  officials  told  us  that 
NAEC  was  making  a  nominal  effort  to  respond  to  the  Assistant  Secretary’s 
statement  of  policy.  Discussions  between  hmrl  and  naec  were  being 
resumed,  but  hmrl  ofBcials  are  strongly  convinced  that  their  future  role  in 
developing  the  technology  for  naec  will  be  kept  to  a  minimum.  They  do  not 
believe  that  naec  intends  to  carry  out  the  Assistant  Secretary’s  policy  to 
any  significant  extent.^ 

As  a  result  of  the  continuing  difficulties,  hmrl  has  released  7  of  its  13 
employees.  In  addition,  company  officials  expect  to  lose  a  potential  Phase 
III  contract  that  they  estimate  at  about  $10  million,  unless  they  are  able  to 
play  a  significant  role  in  outfitting  the  Navy’s  carriers  with  the  lcl  and  the 
LGi.  As  an  alternative,  they  are  exploring  other  market  possibilities, 
including  the  British  Navy. 


‘In  commenting  on  the  drait  report,  DOD  stated  that  the  Navy  has  addressed  this  issue  in  testimony 
provided  to  the  House  Smalt  Business  Committee  on  November  26, 1991.  According  to  the  testimony 
presented  by  NAEC's  commanding  officer,  HMRL's  concerns  must  be  resolved  as  early  as  possible  in 
order  to  preserve  the  Navy's  ability  to  pursue  further  development  and  eventual  acquisition  while 
balancing  program  requirements,  the  requirements  of  CICA,  and  fairness  to  HMRL 
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As  one  further  aspect  of  the  confusion  surrounding  Phase  m  in  this  case, 
the  Navy’s  technical  manager  for  the  prqject  told  us  that,  although  he  had 
managed  about  a  dozen  sbk  projects  in  Phase  n,  he  had  never  heard  of  any 
references  to  Phase  m.  The  projects  had  achieved  the  goals  set  for  them 
by  the  Navy,  and  there  had  been  no  discussion  of  fiirther  activity.  In  6 
years  of  experience  with  sem  projects,  the  technical  manager  had 
concluded  that  once  the  project  reached  the  end  of  I%ase  n,  it  was  on  its 
own.  The  hmrl  case  had  been  the  first  time  in  his  experience  that  further 
activity  became  a  p(»sibility. 

A  second  company,  whid\  asked  to  remain  unidentified,  told  us  of  a 
similar  situation.  In  this  case,  involving  another  dod  laboratory,  the  sent 
Phase  II  winner  believed  its  project  was  well  on  the  way  to  developing  a 
reliable,  cost-effective  technology.  As  a  result,  it  expected  a  further  role 
for  itself  in  Phase  III  but  found  that  the  dod  agency  assumed  full 
responsibility  for  the  work  instead.  The  company’s  principal  investigator 
for  this  project  subsequently  followed  dqd’s  efforts  to  develop  the 
technology.  He  said  that  dod  continued  with  the  project  for  i^ut  5  years 
and  finally  cancelled  it  because  the  design  had  b^ome  too  expensive.  He 
believed  that  his  company  could  have  proceeded  to  a  demonstration  of  the 
technology  within  2  years  of  the  end  of  Phase  n  and  could  have  produced 
the  item  at  a  lower  unit  cost  than  the  dod  design. 

Commenting  on  this  concern,  the  Director  of  another  Phase  II  witming 
company  summarized  his  conclusions  in  a  letter  to  us.  He  suq>ects  that 
the  government  is  using  its  sbir  funds  to  get  innovative  ideas  from  his 
company,  and  haviirg  extracted  promising  ideas,  the  government  proceeds 
to  develop  these  ideas  at  one  of  its  own  laboratories.  He  stated  that  the 
government’s  internal  development  of  a  technology  initially  proposed  by  a 
small  business  makes  the  small  business  feel  that  it  is  competing  directly 
with  the  government  for  the  technology  development  dollars.  He  further 
stated  that  such  activities  can  frustrate  a  small  business  and  will 
eventually  destroy  the  spirit  of  cooperation  between  small  businesses  and 
the  government  He  added  that  the  development  of  a  technology  at  a 
government  laboratory  where  the  technology  was  not  origirudly  conceived 
may  result  in  an  inferior  product  This  can  occur,  according  to  the 
company  president,  when  the  small  business  individuals  whose  scientific 
understanding  and  ingenuity  initially  produced  the  concept  are  not 
permitted  to  develop  and  test  the  concept 

Senior  officials  in  four  other  companies  told  us  that,  on  the  basis  of  their 
extensive  interactions  with  feder^  agencies  and  laboratories,  they  felt  a 
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pervasive  sense  of  competition  with  federal  laboratories.  One  of  these 
officials,  from  a  company  that  has  won  numerous  sbir  awards,  told  us  that 
he  could  cite  some  instances  of  laboratory  support  in  Phase  in,  but  he 
added  that  more  often  the  federal  laboratories  are  competing  with  his 
company. 

In  general,  this  issue  raises  a  basic  question  about  what  a  company  can 
expect  after  it  conducts  rad  for  federal  agencies  in  Phases  I  and  n.  The 
imcertainties  surrounding  this  issue  have  not  been  resolved,  and  further 
controversy  remains  a  possibility.  No  policy  statement,  including  sba’s 
1988  policy  directive,  addresses  this  issue,  but  a  general  policy  statement 
could  help  to  clarify  the  circumstances  under  which  it  may  be  appropriate 
for  an  agency  to  continue  working  with  a  company  throu^  a  follow-on, 
non-SBIR-funded  contract.  As  the  agency  with  responsibility  for  issuing 
policy  directives  for  the  general  conduct  of  the  sbir  Program,  including 
Phase  in,  SBA  could  play  a  nuyor  role  by  including  a  general  policy 
statement  for  dealing  with  this  issue  in  its  directive. 


Conclusions 


The  sales  averages  for  sbir  projects  varied  greatly  among  the  agencies,  hhs 
and  NSF  projects  reported  substantially  higher  sales  per  project  than  any  of 
the  other  agencies,  but  several  factors,  such  as  the  concentration  of 
activity  in  a  relatively  few  projects,  point  to  the  need  for  caution  in  judging 
agency  performance.  The  percentage  of  private-sector  commercialization 
also  varies  among  the  agencies,  ranging  from  about  40  percent  of  dob’s 
project  sales  to  92  percent  of  hhs’  project  sales,  sbir  Program  managers 
have  undertaken  efforts  to  encourage  Phase  in  activity,  dod  is 
emphasizing  the  goal  of  meeting  agency  rad  needs,  then  increasing 
private-sector  commercialization;  nasa,  doe,  and  nsf  are  taking  steps  to 
emphasize  private-sector  commercialization,  although  nasa  is  continuing 
to  stress  agency  utilization  of  sbir  rad. 

Three  issues  need  to  be  addressed  to  strengthen  Phase  ni  activity.  'These 
issues  include  the  extent  of  dod’s  commitment  to  the  goal  of  increasing 
private-sector  commercialization,  inconsistent  practices  in  requiring 
competition  for  projects  entering  Phase  HI,  and  uncertainty  and  conflict 
concerning  when  it  may  be  eqipropriate  to  enter  into  a  Pha%  III  award  if 
the  agency  plans  to  perform  additional  work  on  an  idea  developed  under 
previous  sbir  awards. 

Regarding  the  first  issue,  dod’s  percentage  of  private-sector  sales,  which  is 
lower  tlum  that  of  the  other  four  rn^or  sbir  agencies,  raises  the  question  of 
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whether  dod  should  be  placing  greater  emphasis  on  private-sector 
commercialization.  In  addressing  this  issue,  several  factors  should  be 
taken  into  consideration,  including  dod’s  achievement  of  40  percent  of  its 
sales  in  the  private  sector,  the  difficulty  of  evaluating  private-  sector 
potential  for  proposed  projects,  and  dod’s  strongly  stated  position  that  it 
must  first  meet  the  needs  of  dod  and  its  basic  mission  of  national  defense. 
If  greater  emphasis  is  to  be  given  to  private-sector  commercialization,  one 
approach  would  be  to  give  preference  to  dual-use  technologies  enable  of 
meeting  both  militaiy  and  civilian  needs. 

Regarding  the  second  issue,  federal  officials  support  the  view  that  the 
competition  requirements  of  acA  should  not  apply  to  Phase  IE,  in  that 
these  requirements  have  already  been  met  in  the  prior  phases.  However, 
most  agree  that  the  law  is  not  clear  on  this  point  and  suggest  that  a 
clarffication  of  the  law  would  be  helpfiil.  We  agree  that  a  clarification 
would  be  beneficial  to  achieve  uniformity  in  contract  practices. 

Regarding  the  third  issue,  this  problem  raises  a  basic  concern  about  what 
a  company  can  expect  after  it  conducts  rad  for  federal  agencies  in  Phases 
I  and  II.  The  uncertainties  surrounding  this  issue  have  not  been  resolved, 
and  further  controversy  remains  a  possibility.  As  the  agency  with 
responsibility  for  issuing  policy  directives  for  the  general  conduct  of  the 
SBiR  Program,  including  Phase  IE,  sba  could  play  a  m^or  role  by  including 
a  general  policy  statement  for  dealing  with  this  issue  in  its  directive. 


Matters  for 

Congressional 

Consideration 


To  further  the  goal  of  increasing  private-sector  commercialization,  the 
Congress  may  wish  to  consider  whether  dod  should  place  greater 
emphasis  on  commercialization  through  such  means  as  identifying  and 
selecting  dual-use  technologies  for  sbir  awards. 

To  eliminate  inconsistent  agency  practices  in  requiring  competition  for 
federal,  non-SBlR-fimded  follow-on  contracts,  the  Congress  may  wish  to 
consider  clarifying  whether  Phase  IE  activity  must  comply  with  acA’s 
competitive  procedures  or  whether  the  competition  in  the  earlier  phases 
of  the  program  satisfies  the  acA  requirements. 

To  avoid  misunderstandings  between  companies  and  federal  agencies,  the 
Congress  may  wish  to  consider  requiring  the  sba  Administrator  to  issue  a 
policy  directive  for  agencies  that  are  planning  to  work  on  a  company’s  sbir 
technology  after  the  end  of  sbir  funding.  Such  a  directive  would  clarify  the 
circumstances  under  which  it  may  be  ^propriate  for  an  agency  to 
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continue  working  with  a  company  through  a  follow-on,  non-SBIR-fiinded 
contract 


Agency  Comments 


In  our  draft  report,  we  recommended  that  the  sba  Administrator  develop  a 
policy  statement  for  agencies  planning  to  work  on  a  company’s  SBm 
technology  after  the  end  of  sbk  funding,  sba  did  not  concur  this 

recommendation  because,  in  its  view,  present  legislation  (P.L  97-219) 
does  not  address  sba’s  authority  in  establishing  program  policy  over 
non-SBIR  funding  agreements. 

SBm  legislation,  however,  requires  sba  to  issue  policy  directives  for  the 
general  conduct  of  the  SBm  Ingram  within  the  federal  government.  We 
believe  that  sba,  pursuant  to  this  broad  statutory  mandate,  has  authority  to 
issue  a  policy  directive  concerning  Phase  m  activity,  sba  does  not  disclaim 
such  authority.  Nonetheless,  the  agency  is  conct::med  that  the  statute  does 
not  specifically  address  its  authority  to  establish  program  policy  over 
non-SBIR  fimding  agreements  entered  into  under  Hiase  m.  In  light  of  this 
concern,  we  are  now  suggesting  that  the  Congress  specifically  require  sba 
to  issue  a  policy  directive  for  Phase  IQ. 

SBA  also  stated  that  non-SBIR  funding  agreements  should  be  subject  to  the 
procurement  regulations  of  the  participating  agencies.  While  we  agree 
with  SBA  in  this  matter,  we  nevertheless  believe  that  an  sba  policy  directive 
would  be  helpful  in  avoiding  further  misunderstandings  between  agencies 
and  companies  regarding  this  issue. 

HHS  and  NASA  concurred  with  the  recommendation  that  a  policy  statement 
is  needed  for  agencies  working  on  a  company’s  SBm  technology  after  the 
end  of  SBm  funding,  nasa  also  concurred  with  the  matter  for  consideration 
concerning  contractual  procedures  in  Riase  IQ  and  supported  the  view 
that  Phase  IQ  contracts  should  normally  require  no  further  competition. 
Other  agencies  did  not  comment  on  the  proposed  recommendation  or  the 
matters  for  congressional  consideration. 

DOD  questioned  our  comparison  of  commercialization  achieved  by  dod’s 
SBm  projects  and  those  of  other  federal  agencies,  dod  stated  that  the 
contrast  in  commercialization  results  is  so  striking  because  the 
comparison  is  imqjpropriate.  According  to  dod,  the  difference  between 
mission-oriented  agencies  such  as  dod,  nasa,  and  doe  and 
non-mission-oriented  agencies  such  as  hhs  and  nsf  makes  the  conqiarison 
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of  their  projects*  conunercialization  results  both  inaccurate  and 
misleading. 

While  we  recognize  that  the  agencies  vaiy  widely  in  their  missions  and  that 
these  dififerences  affect  commercialization,  we  believe  that  a  comparison 
of  commercial  results  achieved  by  agencies’  projects  remains  valid.  Such  a 
comparison  helps  in  understanding  the  extent  to  vdiich  each  agency’s 
projects  are  able  to  develop  markets  both  in  the  federal  government  and 
the  private  sector.  The  difference  between  dod  and  other  agencies  in  their 
emphasis  on  piivate^sector  commercialization  and  in  the  percentage  of 
private-sector  sales  achieved  by  their  projects  is  an  issue  for  the  Ckingress 
to  consider.  Because  the  sbir  Ftogram  lacks  criteria  by  which  to  judge 
these  differences,  we  are  suggesting  that  the  C!ongress  may  wish  to 
consider  whether  dod  should  be  doing  more  to  enhance  private-sector 
commercialization.  Our  detailed  responses  to  each  of  dod’s  other 
comments  on  our  draft  report  are  provided  at  the  end  of  appendix  L 
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The  results  of  Phase  IH  included  a  variety  of  benefits  and 
accomplishments  reported  by  sbir  companies.  In  general,  companies 
endorsed  the  benefits  of  the  ssm  Program.  A  mfyority  of  them  cited 
moderate  or  great  benefits,  such  as  increases  in  staff  skills,  retention  or 
hiring  of  valuable  personnel,  and  increases  in  company  credibility  and 
financial  stability.  In  addition,  many  companies  undertook  further  efforts 
to  stimulate  Phase  III  activity,  including  interactions  with  other  companies 
or  investors  in  such  areas  as  licensing  or  joint  venture  agreements. 

One  concern  that  relates  to  the  aggregate  commercial  trends  of  Phase  III  is 
whether  frequent  winners  of  sbir  awards  have  demonstrated  a 
commitment  to  Phase  HI  activity.  To  address  this  issue,  we  compared 
frequent  winners — those  receiving  five  or  more  Phase  n  awards — ^with 
those  receiving  one  to  four  awards.  In  general,  the  average  sales  per 
project  in  Phase  HI  for  the  45  companies  with  five  or  more  awards  is  lower 
than  that  of  companies  with  one  to  four  awards.  In  addition,  fi’equent 
winners  received  substantially  less  additional  developmental  funding  from 
the  private  sector  than  nonfirequent  winners — ^an  average  of  about 
$136,000  per  project  compared  with  about  $291,000  per  project, 
respectively.  A  fairly  broad  spectrum  of  performance,  however,  exists 
among  frequent  winners;  the  range  of  total  sales,  for  example,  extends 
from  no  sales  to  $15  million. 

Frequent  winners  have  received  a  large  amount  of  money  from  the  sbir 
Program.  For  fiscal  years  1983  through  1990,  five  companies  have  received 
almost  $100  million  dollars.  We  are  concerned  that  the  somewhat  lower 
performance  of  frequent  winners  diminishes  the  overall  achievements  of 
the  program  in  Biase  m  while  at  the  same  time  limiting  participation  by 
other  companies.  In  response  to  our  concerns,  sba  initiated  a  study  of  the 
operating  attributes  of  frequent  winners  in  August  1991;  it  expects  to 
complete  this  study  in  early  1992. 


Beneficial  Effects  of 
SBIR  on  Companies 


Involvement  in  the  sbir  Program  contributed  substantially  to  companies’ 
growth.  Table  4.1  indicates  the  percentage  of  growth  that  companies 
attribute  to  the  sbir  Program  since  receiving  ti  leir  first  sbir  award.  The 
table  is  based  on  the  total  number  of  individual  projects  in  each  growth 
category,  as  reported  by  the  1,406  projects  that  provided  information  on 
their  company’s  growth. 
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Tabla  4.1 :  Percentage  of  Company 
Growth  Attributed  to  SBIR 


Number  of  projects 

Percentage  of  growth 

269 

More  thar^  75  percent 

209 

51  to  75  percent 

359 

25  to  50  percent 

569 

Less  than  25  percent 

The  table  shows  that,  for  about  34  percent  of  the  projects,  the  companies 
conducting  them  attributed  more  than  half  of  their  growth  to  sent. 

Companies  also  reported  that  their  sbk  projects  contributed  a  wide  variety 
of  specific  benefits.  For  example,  companies  indicated  thal  they  gained 
either  a  moderate  or  great  benefit  fi'om  an  increase  in  staff  skills  firom 
about  74  percent  of  their  projects.  Figure  4.1  shows  the  percentage  of 
projects  receiving  great  or  moderate  benefits  from  their  Phase  II  awards. 
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Figure  4.1 :  Percentage  of  Projacte 
Receiving  Great  or  Moderate  Benefita 
From  Phaae  II  Awarda 


100  Paieentage  of  pro|eete 


Benaflls 

Companies  associated  with  the  1 ,457  Phase  II  awards  were  asked  to  rate  separately  9  benefits 
gained  from  the  technology  associated  with  these  projects.  ‘Other  benefits,*  marked  for  only  about  2 
percent  of  the  projects,  is  not  shown. 


Among  additional  benefits  resulting  firom  the  specific  Phase  n  project, 
companies  reported  that  20  projects  had  resulted  in  their  making  an  initial 
public  stock  offering.  Ninety  projects  reported  that  they  established 
spin-off  companies.  Of  these,  86  projects  reported  establishing  102  spin-off 
companies.  Hie  remaining  four  projects  did  not  specify  the  number  of 
spin-off  companies  established. 


Additional  Efforts  by 
Companies  in  Phase 

m 


Companies  have  undertaken  additional  efforts  “behind  the  scenes”  to  help 
bring  about  the  favorable  results  that  they  reported.  These  efforts  include 
negotiations  with  other  companies  as  well  as  marketing  activities  on 
behalf  of  the  projects. 
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Interactions  with  other  companies  and  investors  in  Biase  m  were 
reported  for  644  projects.  These  interactions  could  be  finalized 
agreements,  ongoing  negotiations,  or  unsuccessful  negotiations  in  the 
United  States  and  in  foreign  countries.  In  each  of  the  ms^or  areas  of 
interaction,  companies  reported  a  higher  percentage  of  finalized 
agreements  in  the  United  States  than  overseas.  Licensing  and 
marketing/distribution  agreements  represented  the  two  most  frequently 
cited  forms  of  finalized  agreements  in  both  domestic  and  foreign  arenas. 
The  overall  results  are  shown  for  these  projects  in  figure  4.2. 
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ActivniM 


Ongoing  negotiations 
Finalized  agreements 


Percentages  are  based  on  1,034  projecsts  which  obtained  or  expected  additional  developmental 
funding  and/or  sales.  Of  these,  644  projects  repcxted  interactions  with  U.S.  or  foreign  companies  or 
investors. 

Not  shown  are  responses  for  ctomestic  and  for  foreign:  purchase  of  another  company,  investment  in 
another  company,  and  a  general  fothet'  category. 


Companies  reported  that  a  marketing  plan  was  completed  for  about  21 
percent  of  all  projects  responding  to  the  survey;  it  was  being  planned  or 
already  under  development  for  another  33  percent  untile  about  35  percent 
did  not  consider  a  marketing  plan  necessary.  The  remaining  10  percent  did 
not  provide  information  on  this  point  Companies  indicated  somewhat 
lower  levels  of  activity  for  hiring  of  marketing  staff,  publicity  and 
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advertising,  and  test  marketing.  Activities  in  each  of  these  areas,  however, 
were  planned,  under  wsqt,  or  completed  for  more  than  a  fourth  of  all 
projects  responding  to  the  survey. 


One  concern  about  the  SBm  Program  is  whether  frequent  winners  of  sbir 
awards  have  demonstrated  a  commitment  to  Biase  m  activity.  To  explore 
this  issue,  we  compared  the  level  of  niase  m  activity  for  fiequent  and  less 
frequent  winners.  In  making  this  comparison,  we  defined  “fi-equent” 
winners  as  companies  receiving  five  or  more  awards  and  compared  them 
with  companies  receiving  one  to  four  awards.  As  a  further  step,  we 
analyzed  the  results  achieved  by  the  top  13  winners,  which  reported  on 
191  projects  for  an  average  of  £d)out  15  nuise  n  awards  each.  In  general,  as 
shown  in  table  4.2,  frequent  winners  are  achieving  lower  levels  of  activity. 


Table  4.2:  SBIR  Phase  III  Total  Sales  and  Additional  Developmental  Funding  Reported  Relative  to  Number  of  Phase  II 

Awards  Received,  1984-87 

Companies  by  number  of  awards 

Number  of 

Total  sales 

Additional  developmental  funding 

survey 

responses 

Total 

Average  per 
project 

Average  per 

Total  proj^ 

1  to  4  awards 

1,076 

$380,348,741 

$353,480 

$500,540,378 

$  467,757 

5  or  more  awards 

381 

90,186,388 

236,710 

145,464.306 

381,796 

13  most  frequent  winners  (total) 

191 

291,115 

88,701,508 

464,397 

Foster-Miller,  Inc. 

29 

1,622,000 

55,931 

12,976,100 

447,452 

Creare,  Inc. 

21 

7,687,000 

366,048 

18,763,000 

893,476 

Physical  Sciences,  Inc. 

18 

5,770,000 

320,556 

2,382,000 

132,333 

Radiation  Monitoring 

12 

2,860.000 

238,333 

9,154,000 

762,833 

Scientific  Research 

13 

2,367,000 

182,077 

2,461,000 

189,307 

Bend 

14 

16,762,000 

1,197,286 

25,350,417 

1,810,744 

Spire 

11 

10,980,000 

998,182 

4,168,000 

378,727 

EiC 

13 

287,000 

22,077 

5,566,000 

428,153 

Thermacore 

12 

104,930 

8,744 

2,685,085 

223,757 

Quest 

16 

980,000 

61,250 

2,420,000 

151,250 

PDA 

11 

0 

0 

50,000 

4,545 

Jaycor 

12 

0 

0 

199,897 

16,658 

Sparta 

9 

6,183,000 

687,000 

2,526,000 

280.889 

Comparison  of 
Frequent  Winners 
With  Less  Frequent 
Winners  in  Phase  HI 


Overall,  frequent  winners  are  achieving  lower  levels  of  activity  in  total 
sales  per  project.  The  project  average  for  frequent  winners  was  about 
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ftirther  on  <nily  the  13  most  frequent  winners,  the  prqject  average  was 
about  $291,000. 

The  results  obtained  from  conqmring  total  additional  developmental 
funding  for  frequent  and  less  frequent  wiimers  show  a  somewhat  smaller 
difference.  Present  winirers  obtained  additional  developmental  ftinding 
amounting  to  about  $382,000  per  project,  compared  with  about  $468,000 
for  compaities  with  one  to  four  awards.  For  only  the  13  conq>anies,  the 
average  was  about  $464,000. 

However,  the  additional  developmental  ftinding  obtained  from  federal  and 
nonfederal  sources  varies  substantially  between  frequent  and  less  frequent 
winners.  In  general,  as  shown  in  figure  4.3,  companies  with  (me  to  four 
awards  obtained  considerably  more  additicmal  developmental  ftmding  per 
project  from  the  private  sector  than  did  firecpient  wiimers-^about  $290,000 
conqiared  with  $136,000. 
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Figure  4.3:  Sources  of  Additional 
Developmental  Funding  by  Award 
Frequency 


400  Doilara  In  thouaanda 
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winnom 

Soureoo  of  addHIonal  davalopmontal  funding 


Private  sector 
Non-SBIR  tederai  funds 
Later  SBIR  awards 


1 ,076  awards  went  to  companies  with  1  to  4  awards;  these  companies  received  $500.5  miion  in 
additional  developmental  funding. 

381  awards  went  to  companies  with  5  or  more  awards;  these  companies  received  $145.5  milfon  in 
additional  developmental  funding. 

191  awards  went  to  the  13  most  frequent  winners;  these  companies  received  $88.7  million  in 
additional  developmental  funding.  These  191  awards  are  a  subset  of  the  381  awards  to  companies 
with  5  or  mors  awards. 


In  follow-up  discussions  with  PDA  and  Jaycor,  the  two  frequent  winners  of 
Phase  n  awards  that  reported  no  Phase  ID  sales  activily,  the  contracts 
manager  at  each  company  told  us  that  their  projects  involved  dod  work 
with  virtually  no  commercial  market.  The  contracts  manager  at  Jaycor 
said  that  many  of  his  company’s  sbir  projects  were  focused  on  veiy 
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The  Three  Most 
Frequent  Winners  in 
Phase  ni 


Foster-Miller,  Inc., 
Waltham,  Massachusetts 


specialized,  nuclear-related  technologies  for  dod.  In  the  case  of  one 
project  that  did  show  commercial  potential,  the  principal  investigator 
moved  to  another  company.  The  contracts  manager  also  noted  that  acA 
has  made  it  more  difficult  to  move  a  project  into  Phase  in  with  a  federal 
agency.  Because  Jaycor  has  grown  to  700  employees,  it  is  no  longer 
eligible  to  compete  for  sbir  awards  and  has  no  sent  projects  imder  way. 

The  contracts  manager  at  PDA  told  us  that  most  of  PDA’s  work  is 
DOD-related  and  that  commercial  ^plications  are  not  easy  to  identify.  She 
noted  that  most  of  the  sent  awards  had  gone  to  one  specific  division  of  the 
company;  this  division  was  dissolved  in  December  1990,  and  its  staff  no 
longer  works  for  PDA.  She  added  that  PDA  expects  an  award  fi:om  nasa  to 
move  forward  into  Phase  HI. 


For  a  closer  look  at  the  firequent  winners,  we  focused  on  the  three  with  the 
most  Phase  n  awards  between  1984  and  1987.  Two  of  these  three 
companies — Foster-Miller  and  Physical  Sciences  Inc.  (PSI) — expect  a 
substantial  increase  in  their  sales  between  July  1991  and  the  end  of  1993. 

In  addition,  PSI  officials  stated  that  they  have  developed  a  commercial 
strategy  to  boost  their  Phase  III  activity.  Our  analysis  is  based  on  the 
questionnaires  that  the  three  companies  answered  and  on  written 
documents  or  discussions. 


Foster-Miller,  Inc.,  received  the  most  Phase  n  awards  (29)  of  any  company 
during  the  1984-87  time  frame  covered  by  our  survey  and  responded  to 
each  of  the  29  questionnaires  concerning  these  awards.  The  company 
received  the  mjyority  of  these  awards — ^20  of  29 — ^firom  dod.  It  reported 
that,  for  14  of  29  projects,  funding  and/or  sales  have  occurred,  and  further 
work  is  under  way.  For  five  other  projects,  funding  and/or  sales  have  not 
yet  occurred  but  are  expected.  The  remaining  10  projects  have  been 
discontinued. 

Foster-Miller  reported  almost  $13  million  in  additional  developmental 
funding.  Of  this,  subsequent  sbir  awards  used  to  develop  the  technology 
accounted  for  sd)out  $9.8  million  and  non-SBIR  federal  funds  for  slightly 
more  than  $1  million.  Private-  sector  funding  totaled  about  $2.2  million, 
with  the  company  committing  about  $270,000  of  its  own  funds  and 
obtaining  about  $790,000  from  other  companies.  Colleges  or  universities 
and  other  sources  accoimted  for  about  $1.1  million  of  private-sector 
funding. 
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Foster-Miller  reported  about  $1.6  million  in  total  sales  as  of  July  1991 
resulting  from  the  technology  associated  with  these  projects,  nugority 
of  its  sales  (about  $1.1  million)  were  to  dod.  Of  the  10  projects  reporting 
sales,  8  indicated  that  their  first  sale  occurred  in  1989  or  1990. 

Foster-Miller  expected  additional  sales  totaling  about  $15.4  million 
between  the  time  it  completed  the  questionnaires  in  early  1991  and  the  end 
of  1993. 

Foster-Miller’s  activities  with  other  companies  and  investors  in  the  United 
States  and  foreign  countries  were  focused  mainly  on  licensing  agreements, 
the  sale  of  technology  or  rights,  and  marketing/distribution  agreements.  It 
has  finalized  two  licensing  agreements  and  four  marketing/distiibution 
agreements  in  the  United  States.  It  has  also  sold  the  technology  or  rights 
associated  with  two  projects  to  foreign  companies  or  investors. 

Among  its  other  activities,  the  company  ^plied  for  28  patents  based  on 
these  projects  and  has  received  19  of  them.  In  19  cases,  it  indicated  that  a 
marketing  plan  is  planned,  under  way,  or  completed. 

The  company,  founded  in  1956,  has  grown  from  166  employees  at  the  time 
of  its  first  SBiR  award  to  a  current  level  of  266.  Its  gross  revenues  exceed 
$20  million,  with  between  25  and  50  percent  derived  from  sbir.  It  attributes 
between  25  and  50  percent  of  its  company  growth  to  sbir  since  receiving 
its  first  award. 

A  Foster-Miller  vice  president  gave  us  additional  information  about  the 
company.  The  Vice  Resident  noted  that  two  of  the  company’s  most 
significant  achievements  resulted  from  projects  that  went  directly  from 
Phase  I  to  Phase  in  and  were  not  included  in  our  survey.  In  one  of  these 
cases,  involving  a  composite  material  for  bridges,  Foster-Miller  won  a  $6 
million  competitive  procurement  contract  from  dod  to  continue  with  work 
begun  in  Phase  I.  In  the  second  c^.  involving  a  special  Velcro  fastener 
material,  it  received  a  $1  million  sole-source  contract  from  dod,  followed 
by  a  further  $2  million  contract  during  the  buildup  for  the  Desert  Storm 
operation  in  the  Middle  East. 

The  vice  president  also  commented  that  small  businesses  are  prolific 
producers  of  ideas  but  that  they  have  a  difficult  time  in  transmitting  their 
ideas  to  larger  companies.  What  American  industry  needs,  according  to 
the  vice  president,  is  a  mechanism  for  small  companies  to  interact  more 
effectively  with  the  larger  ones.  Large  companies  tend  to  buy  either  the 
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entire  small  company  or  a  specific  product,  but  they  are  less  effective  at 
reaching  out  to  obtain  research  results. 

Regarding  sbir's  effect  on  Foster-Miller,  the  vice  president  told  us  that, 
before  sbk,  the  company  had  only  a  limited  technical  cs^ability  in  specific 
areas,  especially  the  energy  business,  sbr  awards  have  allowed  the 
company  to  build  up  additional  cf^pabilities  in  other  areas  such  as 
materials  and  optics.  In  general,  the  program  has  changed  Foster-Miller 
from  an  engineering  company  working  mainly  with  established 
technologies  to  a  company  working  with  technologies  at  a  much  earlier, 
more  innovative  point  in  ^eir  development 


Creare,  Inc.,  Hanover,  New 
Hampshire 


Creare  responded  to  each  of  the  questionnaires  concerning  its  21  awards. 
DOD  and  NASA  provided  six  awards  £q)iece,  doe  five,  and  nih  two.  Education 
and  NRC  each  provided  one  award.  Creare  reported  that,  for  13  projects, 
funding  and/or  sales  have  occurred,  and  further  work  is  under  way.  In  one 
other  instance,  funding  and/or  sales  have  not  yet  occurred  but  are 
expected.  Seven  projects  have  been  discontinued,  four  of  them  with  Htase 
m  activity  and  three  with  neither  sales  nor  funding. 


Creare  reported  about  $18.8  million  in  additional  developmental  fimding. 
Subsequent  SBm  awards  used  for  development  accounted  for  about  $12.2 
million  and  non-SBIR  federal  fimds  for  about  $6.2  million.  Private-sector 
funding  totaled  about  $1.3  million,  almost  all  of  it  provided  by  Creare 
itself. 


Creare  reported  about  $7.7  million  in  total  sales  as  of  July  1991.  The  vast 
nuyority  of  the  sales  went  to  the  private  sector,  which  accounted  for 
almost  $7  million.  Of  the  eight  projects  reporting  sales,  four  achieved  their 
first  sales  in  1985  and  four  between  1988  and  1990.  Creare  expected 
additional  sales  totaling  $5  million  between  early  1991  and  the  end  of  1993. 

In  its  interactions  with  other  companies,  Creare  indicated  that  it  has 
finalized  one  licensing  and  three  joint  venture  agreements  in  the  United 
States.  It  has  also  finalized  one  agreement  with  foreign  companies  or 
investors  in  each  of  the  following  areas:  licensing,  purchase  of  another 
company,  investment  in  another  company,  joint  venture,  and 
marketing/distribution. 
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The  company  has  implied  for  and  received  two  patents  based  on  these 
projects.  It  reported,  for  all  21  of  its  projects,  that  the  preparation  of  a 
marketing  plan  was  not  needed. 

The  company,  founded  in  1961,  has  grown  from  60  employees  at  the  time 
of  its  first  SBm  award  to  120  as  of  July  1991.  Its  gross  revenues  are  between 
$5  and  $20  million,  with  between  25  and  60  percent  derived  from  sbir.  It 
attributes  between  51  and  75  percent  of  its  company  growth  to  sbir  since 
receiving  its  first  award. 


Physical  Sciences  Inc.,  As  with  Foster-MiUer  and  Creare,  Physical  Sciences  Inc.  (PSI)  responded 

Andover,  Massachusetts  ^  questionnaires  relating  to  its  18  Phase  n  awards  received 

fix)m  1984  to  1987.  dod  provided  10  of  these  awards,  nasa  5,  and  doe,  nih, 
and  NSF 1  each.  PSI  reported  that,  for  9  of  these  18  awards,  funding  and/or 
sales  have  occurred,  and  further  work  is  under  way.  In  five  other 
instances,  funding  and/or  sales  have  not  yet  occurred  but  are  expected. 
The  remaining  four  projects  have  been  discontinued. 

PSI  reported  about  $2.4  million  in  additional  developmental  funding. 
Subsequent  sbir  awards  used  for  development  accounted  for  $508,000  and 
non-SBIR  federal  funds  for  almost  $400,000.  Private-sector  funding  totaled 
about  $1.5  million,  with  the  company  committing  about  $225,000  of  its 
own  funds.  It  obtained  $550,000  from  U.S.  and  $700,000  from  foreign 
venture  capital. 

PSI  reported  about  $6.8  million  in  total  sales  as  of  early  1991.  Almost 
three-quarters  of  these  sales  (about  $4.2  million)  went  to  dod.  About 
$605,000  were  to  nasa  and  $305,000  to  other  federal  agencies.  About 
$684,000  went  to  export  markets  and  $104,000  to  the  private  sector.  PSI 
expected  additional  sales  of  about  $17.5  million  between  the  time  it 
completed  the  questionnaires  in  early  1991  and  the  end  of  1993. 

PSI  indicated  that,  in  the  United  States,  it  had  finalized  one  agreement  in 
each  of  the  following  areas:  licensing,  sale  of  partial  ownership, 
investment  in  another  company,  sale  of  technology  or  rights,  and  joint 
venture.  Seven  other  negotiations  are  under  way  in  the  United  States.  A 
licensing  agreement,  sale  of  partial  ownership  agreement,  and 
marketing/distribution  agreement  have  also  been  finalized  with  foreign 
companies  or  investors. 
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Based  on  technology  associated  with  its  Phase  II  awards,  PSI  applied  for 
four  patents  and  has  received  two.  In  11  instances,  it  indicated  that  a 
marketing  plan  is  planned,  under  way,  or  completed. 

The  company,  founded  in  1973,  has  grown  from  50  employees  at  the  time 
of  its  first  SBiR  award  to  125.  Its  gross  revenues  are  between  $5  million  and 
$20  million,  with  less  than  25  percent  of  them  derived  from  sbir  awards.  It 
attributes  25  to  50  percent  of  its  company  growth  to  sbir  since  receiving  its 
first  award. 

The  chairman,  PSI,  told  us  that  he  prefers  to  start  with  a  commercial 
strategy  and  then  bid  on  sbir  solicitation  topics  and  projects  that  fit  that 
strategy.  Thus,  the  company  views  sbir  as  a  means  of  pursuing  the  ultimate 
goal  of  conunercialization,  not  as  an  end  in  itself. 

PSI  attributes  this  emphasis  on  commercialization  primarily  to  its 
involvement  with  sbir.  In  a  written  summary  of  the  company’s  views,  PSFs 
contracts  manager  stated  that  the  company  has  historically  concentrated 
on  applied  rad,  with  little  interest  and  no  experience  in  commercialization 
of  research  results.  Lai^ely  because  of  the  sbir  Program,  a  corporate 
reorganization  in  July  1987  established  a  division  whose  specific  charter  is 
to  focus  on  potential  commercial  applications  of  its  research  results 
(primarily  those  evolving  out  of  the  sbir  Program),  protection  of  patent 
rights,  licensing,  formation  of  joint  ventures,  and  acquisition  of  third-party 
investments.  PSI  believes  that  the  sbir  Program’s  funds  and  focus  have 
enabled  PSI  and  a  host  of  small  rad  companies  to  begin  this  transition  and 
that,  without  the  sbir  Program,  these  products  and  services  either  would 
not  have  existed  or  would  never  have  “gone  to  market” 

PSI  believes  that  an  analysis  of  sales  anticipated  before  1993  will  not 
reveal  the  extent  of  commercial  successes  resulting  firom  sbir  efforts.  PSI 
has  taken  a  longer  view  of  the  commercialization  process;  it  is  making 
investments  in  continued  development  and  does  not  expect  to  realize  the 
full  return  within  the  first  5  years  after  Phase  II  completion.  It  is  optimistic 
about  the  potential  of  some  of  the  SBiR-related  products  over  the  next  10 
years  and  considers  that  to  be  a  more  jqipropriate  time  frame  forjudging 
the  success  of  sbir  Phase  III  achievements.  In  addition,  PSI  believes  that 
its  corporate  change  in  emphasis  resulting  from  participation  in  sbir  will 
yield  an  even  higher  percentage  of  commercially  viable  iimovadons  for 
SBIR  topics  pursued  in  fiscal  year  1988  and  after. 
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Monitoring  of 
Companies  With 
Multiple  Awards 


Given  the  concerns  about  comparative  levels  of  performance  in  Phase  El, 
especially  as  they  relate  to  frequent  wiimers,  we  explored  the  question  of 
monitoring  company  performance.  Although  several  sbir  Program 
managers  were  opposed  to  monitoring,  a  review  of  frequent  winners’ 

Phase  in  activity  may  be  appropriate  because  of  the  large  amount  of  SBm 
money  received  by  frequent  winners  and  the  somewhat  lower 
performance  among  frequent  winners  in  general.  In  addition,  the  large 
amount  of  sbk  funds  provided  to  the  frequent  winners  limits  participation 
by  other  companies. 

Among  the  sbir  Program  officials  who  were  opposed  to  monitoring,  dod’s 
program  coordinator  told  us  that  dod  has  procedures  in  place  to  ensure 
that  unqualified  companies  do  not  receive  sbir  awards.  He  added  that  even 
seemingly  less  productive  companies  are  performing  a  valuable  r&d 
service  that  may  not  be  captured  through  the  criteria  of  additional 
developmental  funding  and/or  actual  or  pending  sales  in  Phase  m.  nasa’s 
program  manager  said  that  sbir  companies  have  no  responsibility  other 
than  to  meet  their  Phase  I  and  n  commitments.  He  added  that,  until  the 
language  of  the  law  and  policy  direction  state  unequivocally  that  Phase  III 
activity  must  be  demonstrated  before  further  awards  can  be  received,  it 
would  be  wrong  to  penalize  companies  with  lower  levels  of  Phase  III 
activity. 

In  a  few  instances,  however,  program  nuinagers  told  us  that  company 
performance  in  Phase  El  might  influence  their  decisions  about  who 
receives  sbir  awards.  The  doe  program  manager,  for  example,  said  that  in 
the  evaluation  of  both  Phase  I  and  Phase  E  proposals,  consideration  is 
given  to  the  amount  of  Phase  IE  funding  received  for  previous  doe  Phase  E 
projects.  This  modification  to  the  evaluation  process  was  introduced  at  the 
beginning  of  1991.* 

The  large  amount  of  sbir  money  received  by  frequent  winners  makes  the 
concern  about  frequent  winners  more  important.  According  to  data 
provided  by  sba,  for  example,  the  five  companies  obtaining  the  most  sbir 
money  from  fiscal  years  1983  through  1990  have  received  a  total  of  $97.4 
miUion.  These  companies  include  Foster-MiUer  ($31  million),  Creare  ($19.2 
miUion),  Sparta  ($16.7  million).  Spire  ($15.8  nullion),  and  Radiation 


'In  commenting  on  the  draft  report,  SBA  stated  that  the  agency  use  of  company  performance,  i.e., 
commercialization,  as  a  factor  in  SBIR  selections  may  be  legally  questionable  and  that  company 
performance  in  Phase  III  should  not  be  a  factor  in  agencies’  SBIR  procurement  selection  decisions.  In 
discussing  this  issue  with  us,  DOE  SBIR  program  officials  told  us  that,  when  selecting  among 
competing  projects  for  SBIR  awards,  they  are  using  follow-on  funding  as  a  criterion  only  for 
tie-breaking  purposes  as  permitted  by  current  legislation. 
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Monitoring  ($14.7).  Collectively,  these  companies  have  received  702  sbir 
awards,  consisting  of  529  Phase  I  awards  and  173  Phase  n  awards. 

Because  the  large  amount  of  fimds  provided  to  frequent  winners  limits 
participation  by  other  companies  while  the  somewhat  lower  level  of  sales 
by  frequent  winners  in  Pha^  m  diminishes  the  overall  achievements  of 
the  program,  we  concluded  that  further  review  of  Phase  m  activity  among 
frequent  winners  is  needed,  sba  officials  told  us  that  they  agree  on  the 
need  to  develop  farther  information  concerning  frequent  winners.  In 
response  to  our  concerns,  sba  initiated  a  study  of  frequent  winners  in 
August  1991  to  determine  the  operating  attributes  of  these  firms  and 
expects  to  complete  the  study  in  early  1992.^ 


In  general,  companies  endorsed  the  benefits  of  the  sbir  program.  A 
msuority  of  them  cited  moderate  or  great  benefits  such  as  increases  in  staff 
skills,  the  hiring  or  retention  of  valuable  personnel,  and  increases  in 
company  credibility  and  financial  stability.  Companies  also  reported 
activities  such  as  finalized  or  ongoing  negotiations  with  other  companies 
or  investors  at  home  and  abroad  to  stimulate  activity  in  Phase  HI;  these 
negotiations  frequently  involved  licensing  and  marketing/distribution 
agreements. 

A  comparison  of  frequent  winners — ^those  receiving  five  or  more  Phase  n 
awards — ^with  less  frequent  winners  showed  that,  in  general,  frequent 
wiimers  are  achieving  lower  levels  of  total  sales  per  project.  Although  total 
additional  developmental  funding  was  more  nearly  equal  in  the  two 
groups,  frequent  winners  obtained  substantially  less  additional 
developmental  funding  per  project  from  the  private  sector  than  companies 
with  one  to  four  awards.  The  m^ority  of  additional  developmental  funding 
for  frequent  wiimers  came  from  the  federal  government. 

The  top  five  winners  have  received  almost  $100  million  in  sbir  funds  and 
more  than  700  Phase  I  and  n  awards  since  the  inception  of  the  sbk 
Program.  The  limitation  of  participation  for  other  companies  as  a  result  of 
the  large  amounts  of  funds  to  frequent  winners  and  the  somewhat  lower 
level  of  performance  among  frequent  winners  in  general  raise  concerns 
about  their  role  in  the  sbir  Program.  Because  sba  has  initiated  a  further 
study  of  frequent  Avinners  to  determine  the  operating  attributes  of  these 
firms,  we  are  making  no  recommendations  concerning  frequent  winners. 


commenting  on  our  draft  report,  SBA  stated  that  while  it  is  undertaking  a  study  to  determine  the 
operating  attributes  of  these  firms,  SBA  has  in  no  way  assumed  that  such  firms  can  or  should  be 
characterized  as  having  a  lower  or  higher  level  of  performance. 


Page  68 


GAO/BCED-92>S7  Small  Bnaincas  Inaovadon  Research 


Appendix  I _ 

Comments  From  the  Department  of  Defense 


Note;  GAO  comments 
supplementing  those  in  the 
report  text  appear  at  the 
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See  comment  1 . 


See  comment  2. 


See  comment  3. 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE  FOR  ACQUISITION 
WASHINGTON,  DC  20S01-30S1 


OFFICE  OF  SMAIX 
BUSINESS  AND  SHALL 
DISADVANTAGED 
BUSINESS  UTILIZATION 


2JANSK 


Mr.  John  M.  01s,  Jr. 

Director,  Housing  and 
Community  Development  Issues 
Resources,  Community,  and 
Economic  Development  Division 
U.  S.  General  Accounting  Office 
Washington,  DC  20548 


Dear  Mr.  01s: 

This  is  the  Department  of  Defense  (DoD)  response  to  the  General  Accounting  Office 
(GAO)  draft  report  entitled—’FEDERAL  RESEARCH:  Small  Business  Innovation  Research 
Shows  Success  But  Can  Be  Strengthened*  (GAO  Code  385513/OSD  Case  8853-A).  Generally, 
the  DoD  agrees  with  the  information  presented  in  the  report  and  has  provided  needed  factual  and 
technical  corrections  separately.  The  DoD  agrees  with  the  information  in  the  body  of  the  report. 
The  Executive  Summary  does  not,  however,  reflect  the  report  content  accurately,  which  misleads 
the  reader. 

The  DoD  is  complying,  and  has  always  complied,  with  the  legislated  requirements  for 
Small  Business  Innovation  Research  specified  by  Congress.  The  GAO  acknowledges  that  there 
is  no  established  standard  for  measuring  the  achievement  of  the  goal  to  increase  private  sector 
commercialization  derived  from  Federal  Research  and  Development.  Even  with  the  absence  of 
a  standard,  the  DoD  has  achieved  a  commendable  40  percent  private  sector  commercialization. 

Throughout  the  rqiort,  the  DoD  is  compared  to  other  Federal  Agencies  without 
explaining  the  differences.  Mission  oriented  agencies,  such  as  the  DoD,  the  Department  of 
Energy  and  the  National  Aeronautics  and  Space  Administration,  have  a  commitment  to 
promoting  research  and  development  projects  that  meet  the  internal  needs  of  the  agencies.  Non¬ 
mission  oriented  agencies,  lite  the  National  Institutes  of  Health  and  the  National  Science 
Foundation,  foster  research  and  development  work  that  is  primarily  used  outside  the  agency. 
In  the  report,  mission  oriented  agencies  and  non-mission  oriented  agencies  are  grouped  together 
and  comparisons  made  between  unlike  agencies.  The  contrast  is  so  striking  because  the 
comparison  is  inappropriate  -  due  to  the  underlying  assumption  that,  with  some  Small  Business 
Innovation  Research  procedural  differences,  the  agencies  are  the  same.  That  assumption  is  both 
inaccurate  and  misleading. 

The  DoD  Small  Business  Innovation  Research  program  funds  high  innovation,  leading- 
edge  technology  where  often  the  commercial  market  has  yet  to  be  established.  As  mentioned 
in  the  GAO  report,  years  of  research  and  development  and  marketing  are  necessary  to  develq) 
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See  comment  4. 
See  comment  5. 


See  comment  6. 


a  private  sector  market  for  an  emerging  technology.  Since  the  DoD  has  taken  the  lead  in 
developing  new  technology  through  Small  Business  Innovation  Research  funding  and  this 
technology  meets  DoD  requirements,  sales  to  the  Federal  Government  (in  addition  to  sales  to 
the  private  market)  are  expected.  The  report  shows  that  small  firms  participating  in  the  five 
major  Small  Business  Innovation  Research  agency  programs  have  commercialized  in  the 
Government  and  private  market  places.  The  Government  market  should  be  included  as  part  of 
the  Small  Business  Innovation  Research  commercialization  goal. 

The  GAO  ignores  the  central  thrust  of  the  DoD  Small  Business  Innovation  Research 
program,  which  offers  small  companies  the  opportunity  of  marketing  their  innovative  concepts 
in  response  to  the  unique  DoD  research  and  technology  needs.  The  DoD  provides  a  mixture  of 
solicitation  topics  that  vary  from  broad  to  focused  research,  allowing  sniall  firms  to  pursue  a 
variety  of  new  technologies  that  have  DoD  and  commercial  potential  applications.  As  the  report 
indicates,  significant  commercial  spinoffs  from  Small  Business  Innovation  Research  projects  have 
occurred. 

The  GAO  also  mentions  that  some  projects  are  discontinued  without  Phase  III  activity. 
Developing  a  new  technology  is  risky  and  finding  private  funding  for  basic  research  is  very 
difficult  or  impossible.  The  DoD  is  sharing  the  risk  with  high-technology  small  firms  by 
providing  funding  for  research  and  development,  exploring  technologies  that  would  otherwise 
not  be  pursued.  However,  less  than  1(X)  percent  success  in  any  research  program  is  expected. 
Not  all  innovative  ideas  are  strong  enough  to  succeed.  Knowledge  is,  however,  often  gained 
from  such  unsuccessful  projects  that  leads  to  eventual  success. 

The  Department  of  Defense  appreciates  the  opportunity  to  review  and  comment  on  the 
GAO  draft  report.  (Suggested  factual  and  technical  changes  were  provided  separately.) 

Sincerely, 

HORA^^  CROUCH 

Director 


Page  71 


GACVRCED-92-87  Small  Buaiiieaa  loiiovatlfm  Reaearch 


Appendix  I 

ComnenU  From  tke  Department  of  Defenae 


GAO  Comments 


The  following  are  gao’s  comments  on  dod’s  letter  dated  January  2, 1992. 


1.  We  disagree  with  dod’s  general  statement  that  the  executive  summary 
does  not  reflect  the  report  content  accurately,  dod’s  letter  does  not  discuss 
this  statement  in  greater  detail,  and  dod’s  technical  annotations  to  our 
draft  executive  summary  focused  only  on  the  portions  comparing  dod’s 
SBR  project  results  with  those  of  other  agencies.  However,  in  response  to 
dod’s  technical  annotations,  we  have  revised  the  executive  summary  to 
focus  more  directly  on  dod’s  increasing  en^>hasis  on  meeting  its  agency 
RAD  needs  while  its  percentage  of  private-sector  conunercialization 
remains  lower  than  that  of  the  other  four  nuyor  sbk  agencies. 

2.  We  neither  state  nor  imply  anywhere  in  the  report  that  dod  is  not 
complying  with  the  legislated  requirements  for  sbir  specified  by  the 
Congress.  Because  there  are  no  established  criteria  by  which  to  evaluate 
dod’s  40-percent  rate  of  private-sector  coimnercialization,  we  have  made 
the  issue  of  increasing  dod’s  commercialization  rate  a  matter  for 
congressional  consideration.  While  dod  considers  the  40-percent 
commercialization  rate  "commendable,  ”  we  remain  concerned  that  this  is 
the  lowest  rate  among  the  rmqor  sbir  agencies  and  that,  at  the  same  time, 
DOD  is  taking  steps  to  make  the  sbir  Program  more  responsive  to  the 
agency  mission.  As  we  stated  in  the  report,  this  step  may  further  limit  the 
potential  of  dod’s  projects  for  application  in  the  private  sector. 

3.  We  have  added  a  reference  incorporating  dod’s  concern  about  the 
differences  between  the  agencies  on  page  5  of  our  executive  summary. 
However,  we  disagree  that  such  differences  invalidate  a  comparison 
between  the  agencies.  Because  dod’s  concerns  about  a  comparison  of  its 
project  results  with  those  of  other  agencies  are  central  to  dod’s  comments 
on  our  draft  report,  we  have  discussed  this  portion  of  dod’s  comments  in 
the  main  body  of  the  report.  Our  views  in  this  regard  are  provided  on 
pages  7  and  52  and  53. 

4.  We  agree  with  dod’s  view  that  the  government  market  should  be 
included  as  part  of  the  sbir  Program’s  commercialization  trends.  In 
developing  oiu*  data  about  sales  achieved  by  agencies’  projects,  we  clearly 
included  sales  to  the  federal  govenunent  as  part  of  the  aggregate  activity. 
However,  we  are  also  concerned  about  private-sector  commercialization, 
one  of  the  goals  of  the  sbir  Program.  'Throughout  the  report,  we  have 
carefully  distinguished  between  the  private  and  federal  markets  to  show 
the  extent  to  which  companies  are  able  to  develop  private-sector  markets 
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for  their  rad.  We  also  noted  the  differing  emphasis  on  private-sector 
commercialization  by  program  managers  at  various  agencies  and  dod’s 
increasing  emphasis  on  meeting  its  own  agency  rad  needs,  another 
program  goal.  Thus,  while  our  report  already  acknowledges  the  important 
role  of  sales  to  the  agencies,  the  issue  that  needs  to  be  addressed  is 
whether  dod  should  be  giving  somewhat  more  en^hasis  to  projects  with  a 
greater  “dual  use”  or  private-sector  commercialization  potenth^ 

5.  We  disagree  with  ood’s  statement  that  we  ignored  the  central  thrust  of 
the  DOD  SBiR  Program,  which  allows  companies  to  market  their  concepts  to 
meet  dod  needs.  Our  report  presents  detailed  data  concerning  the  amount 
of  sales  by  companies  to  dod  (and  other  federal  agencies).  These  sales 
were  presented  as  part  of  our  aggregate  data  in  ch^ter  2  and  our 
agency-specific  data  in  cluqpter  3.  We  also  discussed  the  efforts  that  dod  is 
making  to  focus  sbir  rad  on  its  agency  needs  and  thus  enhance  Hiase  in 
activity.  Rather  than  ignoring  this  thrust  of  the  program,  we  pointed  out 
that  dod’s  concern  about  meeting  agency  rad  needs  is  a  factor  that  the 
Congress  should  take  into  consideration  in  deciding  whether  to  place 
more  emphasis  on  private-sector  commercialization. 

6.  We  agree  with  dod’s  comments  on  the  risks  as  well  as  potential  benefits 
associated  with  discontinued  projects.  As  shown  in  figure  2.4  of  our 
report,  high  risk  and  iimovation  played  a  great  or  moderate  role  in 
discontinuing  about  19  percent  of  the  projects  that  were  no  longer  active 
at  the  time  of  our  survey. 
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IWNSA 

National  Aeronautics  and 
Space  Administration 

Washington.  DC 
20546 

Office  of  the  Administrator 


Mr.  John  M.  01s,  Jr. 

Director,  Housing  and 

Community  Development  Issues 
Resources,  Community,  and 

Economic  Development  Division 
United  States  General  Accounting  Office 
Washington,  DC  20548 


Dear  Mr.  01s: 

This  is  the  National  Aeronautics  and  Space  Administration's 
(NASA)  response  to  the  General  Accounting  Office  (GAO)  draft 
report  GAO/RCED-92-37,  entitled  "Federal  Research:  Small 
Business  Innovation  Research  Shows  Success  But  Can  Be 
Strengthened,"  which  was  received  with  your  letter  dated 
November  26,  1991,  for  our  review  and  comment. 

The  enclosed  represents  detailed  comments  to  the  report. 
Overall,  our  comments  address  points  or  conclusions  made  in  the 
report  which  need  clarification  or,  in  some  cases,  correction. 

I  hope  these  will  be  of  assistance  in  completing  the  final 
version.  We  appreciate  the  opportunity  of  offering  these 
comments  and  working  with  the  GAO  Evaluator-in-charge. 

Sincerely, 

^ohn  E.  O'Brien 
Assistant  Deputy  Administrator 

Enclosure 
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Comments  on  the  GAO  Draft  Report  Entitled: 

Federal  Research:  Small  Business  Innovation  Research 
Shows  Success  But  Can  Be  Strengthened 


The  subject  draft  report  concludes  there  has  been 
significant  Phase  III  activity  in  both  sales  and  additional 
development  aimed  at  both  government  and  private  sector  markets, 
and  that  most  companies  endorse  the  SBIR  program,  often 
attributing  growth  and  successful  expansion  of  capabilities  and 
markets  substantially  or  in  part  to  their  SBIR  projects.  It 
recommends  that  four  issues  should  be  addressed  by  the  congress 
in  considering  re-authorization  and  ways  to  increase  the 
achievement  of  legislative  objectives  in  Phase  III. 

The  issues  identified  are  (1)  the  extent  of  the  Department 
of  Defense  (DOD)  commitment  to  increasing  private  sector 
commercialization  (the  DOD  funds  more  than  half  the  total  SBIR 
program),  (2)  inconsistent  practices  among  agencies  in  requiring 
competition  for  projects  entering  Phase  III  contracts  by  the 
government,  (3)  the  need  to  clarify  the  circumstances  under  which 
an  agency  may  pursue  in-house  continuation  of  developments 
initiated  under  SBIR,  and  (4)  the  relatively  lower  commercial 
performance  (both  sales  and  additional  development  funding)  of 
many  companies  which  have  received  five  or  more  Phase  II  awards, 
which  is  an  issue  currently  being  addressed  by  the  Small  Business 
Administration  (SBA). 

We  found  the  report  to  be  a  comprehensive  attempt  to  assess 
Phase  III  progress  as  measured  by  sales  and  additional 
development  funding  following  Phase  II  projects.  However,  since 
we  have  not  seen  the  data  GAO  used  as  the  basis  of  their  study, 
we  cannot  comment  on  the  accuracy  or  completeness  of  the  results 
shown,  particularly  those  which  relate  to  the  NASA  SBIR  program. 
The  following  comments  are  made  on  the  four  identified  issues. 

1.  We  have  no  comment  to  offer  on  Issue  (1)  relative  to  DOD 
SBIR  program  emphasis  and  commitment  to  commercialization  of  SBIR 
results . 

2.  With  regard  to  Issue  (2),  we  agree  that  existing 
legislation  regarding  competition  in  contracting  does  not  seem 
consistent  with  the  legislative  intent  for  SBIR.  We  agree  that 
clarification  is  required,  and  support  the  position  that  non-SBIR 
Phase  III  follow-on  contracts  with  Phase  II  performers  should 
normally  require  no  further  competition,  on  the  basis  that 
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Phase  I  and  Phase  II  have  satisfied  the  requirements  for 
competitive  selection  including  logical  Phase  III  follow-on 
government  applications.  A  satisfactory  proposal  and 
determination  of  the  capability  of  the  firm  to  perform  the 
desired  Phase  III  work  should  then  be  considered  sufficient  basis 
for  selection. 

3.  We  know  of  no  specific  problems  in  the  NASA  program 
related  to  Issue  (3),  but  we  agree  that  it  is  desirable  that 
there  be  established  more  specific  guidelines  clarifying  the 
rights  of  government  for  in-house  development  and  the  rights  of 
SBIR  firms  to  receive  contracts  for  follow-on  work  subsequent  to 
Phase  II,  so  that  both  parties  may  benefit  equitably. 

4.  With  regard  to  Issue  (4)  we  believe  the  Phase  III 
commercialisation  performance  of  SBIR  contractors  who  have 
received  numerous  Phase  II  awards  should  be  further  assessed  to 
determine  whether  there  are  ways  to  encourage  their  wider 
achievement  of  commercial  applications,  if  in  fact  they  have  been 
less  successful  in  their  efforts  or  have  made  minimal  efforts  in 
that  direction. 

However,  it  must  not  be  overlooked  that  the  success  of  such 
firms  in  winning  several  --  and  in  some  instances,  many  —  Phase 
II  awards  suggests  they  are  fulfilling  other  legislative 
objectives  for  SBIR,  including  stimulating  technological 
innovation  and  assisting  federal  agencies  in  meeting  their  R&D 
needs,  including  Phase  III  government  applications.  In  so  doing 
they  are  adding  to  U.S.  technical  competence  and  competitiveness, 
and  are  contributing  to  economic  growth  and  employment  through 
their  innovations  and  development  activities 

Achievement  of  commercial  applications  may  sometimes  depend 
more  on  the  inherent  commercial  potential  of  projects  solicited 
by  the  agencies  than  on  factors  under  the  control  of  the  small 
business.  For  agencies  such  as  NASA,  which  are  required  to 
achieve  unique  and  technologically  specialized  mission 
objectives,  it  has  happened  that  not  all  Phase  II  projects  have 
possessed  readily  identifiable  and  achievable  commercial 
applications.  However,  as  GAO  noted  in  the  report,  one  effort  by 
NASA  to  change  this  situation  is  to  choose  a  larger  fraction  of 
technical  subtopics  for  our  annual  SBIR  solicitation  that  involve 
the  development  of  "dual  use"  innovations  and  technologies,  those 
which  suggest  reasonable  prospects  for  commercial  application 
potential  while  satisfying  NASA  R&O  needs. 

In  addition  to  the  foregoing  comments  on  the  general  content 
and  issues  identified  by  GAO,  we  offer  the  following  detailed 
comments  on  particular  sections  of  the  report  which  should  be 
incorporated  as  corrections  to  the  draft  report. 
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Now  on  p.  35. 
See  comment  2. 


Now  on  p.  37. 
See  comment  3. 


Now  on  p.  55. 
See  comment  4. 

See  comment  5. 


Page  39:  The  first  paragraph  states  that  "Program  managers 
at  four  of  the  five  major  SBIR  agencies  told  us  that  they  are 
making  efforts  to  enhance  activity  in  Phase  III.  SBIR  officials 
in  DOD  are  placing  greater  emphasis  on  meeting  agency  needs.  By 
contrast,  SBIR  officials  in  NASA,  DOE,  and  NSF  are  taking  steps 
to  emphasize  private  sector  commercialization."  This  statement, 
while  true,  could  lead  readers  to  infer  that  NASA's  Phase  III 
emphasis  may  be  exclusively  on  private  sector  commercialization, 
when  in  fact  we  emphasize  both  agency  utilization  —  helping  us 
achieve  our  mission  objectives  is  mandatory  —  and  increasing 
commercialization.  We  suggest  an  appropriate  modification  of 
this  potentially  misleading  statement  in  the  report. 

Page  41:  The  fourth  paragraph  states  that  "...at  least  half 
of  its  topics  (and  subtopics)  must  have  identifiable  commercial 
potential."  The  word  "topics”  should  be  deleted,  and  the  phrase 
should  read:  "...at  least  half  of  its  technical  subtopics  must 
have  identifiable  commercial  potential."  Topics  are  broad,  e.g. 
Materials  and  Structures,  and  do  not  change  from  year  to  year. 
"Technical  subtopics"  are  the  specific  areas  in  which  small 
businesses  are  invited  to  submit  proposals  and  are  frequently 
modified  each  year.  It  is  the  subtopics  in  which  we  are 
requiring  greater  opportunity  for  commercial  applications.  Such 
can  be  thought  of  as  "dual  use"  subtopics,  in  the  meaning  of  the 
term  used  elsewhere  in  the  report. 

The  fifth  paragraph  states:  "...which  submit  the 
topics  for  the  program  manager's  review."  The  word  "subtopics" 
should  be  substituted  for  "topics"  in  this  sentence,  consistent 
with  the  above  comment. 

Page  63:  The  last  sentence  reads:  "Figure  4.1  shows  the 
percentage  of  projects  reporting  moderate  or  great  benefits  for 
their  projects."  It  would  appear  that  this  should  read  "Figure 
4.1  shows  the  percentage  of  projects  reporting  benefits  for  their 
companies."  Similarly,  it  would  seem  that  Figure  4.1  should  be 
labeled  "Percentage  of  Phase  II  Projects  Providing  Great  or 
Moderate  Benefits  to  their  Companies".  And,  from  the  context  of 
the  paragraph  following  Figure  4.1,  it  seems  likely  that  the 
reference  to  "Ninety  projects..."  should  instead  be  to  "Ninety 
companies . . . ” . 
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The  following  are  gao’s  comments  on  nasa’s  letter  dated  December  16, 
1991. 


GAO  Comments 


1.  While  agreeing  with  our  concerns  about  the  need  to  further  assess  the 
performance  of  frequent  Htase  n  award  winners  in  Hiase  m,  nasa  makes 
two  additional  points:  (1)  the  receipt  of  several  or  many  awards  suggests 
that  frequent  winners  are  fulfilling  other  (noncommercial)  legislative 
objectives  of  sbir  and  (2)  the  achievement  of  commercial  applications  may 
sometimes  depend  more  on  the  agency  solicitation  than  on  ^e  small 
business. 

Regarding  the  first  point,  we  focused  our  review  of  frequent  winners  on 
their  Phase  HI  commercialization  results  rather  than  on  other  program 
goals  because  of  congressional  concerns  about  the  commercialization 
issue.  We  do  not  agree  with  nasa’s  statement  that  the  receipt  of  many 
awards — ^by  itself— suggests  that  other  program  objectives  (such  as 
stimulating  innovation)  are  being  fulfilled.  While  acknowledging  that 
frequent  winners  may  be  achieving  other  program  goals,  we  believe  that 
attention  should  remain  focused  on  the  primary  issue  under 
discussion — the  extent  of  commercialization  among  the  frequent  wiimers. 

Regarding  the  second  point,  nasa  makes  an  important  comment:  An 
agency  can  contribute  significantly  to  commercialization  through  the 
projects  it  solicits.  While  NASA  cites  this  point  in  cormection  with  the 
performance  of  frequent  wirmers,  we  believe  that  it  supplies  to  projects 
conducted  by  nonfrequent  winners  as  well.  Variations  in  agency  emphasis 
on  commercialization,  which  we  discussed  in  detail  beginning  on  page  35, 
do  affect  agency  solicitations,  the  selection  of  projects,  and  the  type  of 
nrarkets  achieved  by  sbir  technologies.  For  this  reason,  we  compared  the 
initiatives  being  undertaken  by  several  m^jor  sbir  agencies  to  meet  agency 
RAD  needs  or  to  boost  the  potential  for  private-sector  commercialization. 

2.  We  have  made  the  requested  changes. 

3.  We  have  made  the  requested  changes. 

4.  We  disagree  with  the  suggested  changes  but  have  made  sli^t  revisions 
to  clarify  our  statements.  Our  data  were  based  on  “great  or  moderate 
benefits”;  the  suggested  deletion  of  “great  or  moderate”  would  be 
inaccurate.  We  agree  with  nasa  that  the  projects  benefited  the  companies; 
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however,  we  wish  to  emphasize  that  the  benefits  were  derived  firom  the 
Phase  n  awards. 

6.  NASA  is  correct  in  noting  an  inconsistency  in  our  draft  report^  however, 
our  unit  of  analysis  is  projects,  not  companies.  We  have  corrected  our 
statement  to  reflect  projects  and  make  the  statement  consistent 
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Comments  From  the  Department  of  Health 
and  Human  Services 


DEPARTMENT  OF  HEALTH  &  HUMAN  SERVICES 


JAN  3  1992 


Office  of  Inspector  General 


Washington.  D.C.  20201 


Mr.  John  M.  01s,  Jr. 

Director,  Housing  and 

Conununlty  Development  Issues 
United  States  General 
Accounting  Office 
Washington,  D.C.  20548 

Dear  Mr.  01s; 

Enclosed  are  the  Department's  comments  on  your  draft  report, 
"Federal  Research:  Small  Business  Innovation  Research  Shows 
Success  But  Can  Be  Strengthened."  The  comments  represent  the 
tentative  position  of  the  Department  and  are  subject  to 
reevaluation  when  the  final  version  of  this  report  is  received. 

The  Department  appreciates  the  opportunity  to  comment  on  this 
draft  report  before  its  publication. 

Sincerely  yours, 


Richard  P.  Kusserow 
Inspector  General 


Enclosure 
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3ee  comment  1. 


COMMENTS  OF  THE  DEPARTMENT  OF  HEALTH  AMD  HUMMl  SERVICES 
ON  THE  GENERAL  ACCOUNTING  OFFICE  fGAOt  DRAFT  REPORT. 
■FEDERAL  RESEARCH »  BUSINESS  INNOVATION  RESEARCH  SHOWS 

SUCCESS  BUT  r-AN  BE  STRENGTHENED."  NOVEMBER  1991 


General  Comments 

We  are  pleased  that  the  GAO  draft  report  reflects  the 
significant  commerclallxatlon  success  In  the  private  sector  of 
projects  funded  by  the  Departawnt  of  Health  and  Hunan  Services 
(DHHS)  under  the  Small  Business  Innovation  Research  (SBIR) 
Program.  The  small  business  community's  products  have  made 
Important  contributions  to  the  improvement  of  the  Nation's 
health  as  a  result  of  their  participation  In  the  SBIR  Program. 

It  Is  our  understanding  that  the  data  in  the  report  does  not 
Include  any  Information  on  projects  fiinded  by  other  PHS 
components  and  Includes  only  the  National  Institutes  of  Health 
(NIH)  projects.  However,  both  the  SBIR  Contracts  and  Grants 
Announcements  are  entitled  'Solicitation  (or  Omnibus 
Solicitation)  of  the  Public  Health  Service  for  Small  Business 
Innovation  Research  (SBIR)  Contract  Proposals  (or  Grant 
Applications).*  SBIR  solicitations  always  Include  NIH  and  the 
Alcohol,  Drug  Abuse  and  Mental  Health  Administration  and  often 
Include  the  Centers  for  Disease  Control,  Food  and  Drug 
Administration,  and  other  PHS  agencies.  Consequently,  the 
report  should  refer  to  the  Public  Health  Service  or  the 
Department  of  Health  and  Human  Services,  rather  than  NIH,  as 
the  participating  agency. 

Although  the  report  contains  no  recommendations  for  the 
Department  of  Health  and  Human  Services,  we  have  the  following 
comments  on  the  recommendation  to  the  Small  Business 
Administration  (SBA). 

GAO  Recommendation 

To  avoid  conflict  between  companies  and  federal  agencies,  the 
SBA  Administrator  should  develop  a  policy  statement  for 
agencies  that  are  planning  to  work  on  a  company's  SBIR 
technology  after  the  end  of  SBIR  funding.  Such  a  policy 
statement  should  clarify  the  circumstances  under  v^lch  the 
agency  will  continue  working  with  the  company  through  a  follow- 
on,  non-SBIR-funded  contract. 

Department  Commenta 

We  concur.  The  agencies  that  intend  to  work  on  a  company's 
SBIR  technology  following  expiration  of  federal  funding  would 
benefit  from  the  recommended  policy  statement. 
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The  following  are  gao’s  comments  on  hhs’  letter  dated  January  3, 1992. 


GAO  Comments 


I 


1.  hhs’  statement  that  our  data  include  only  nih  projects  for  hhs  is  correct 
However,  nih  has  accounted  for  more  than  90  percent  of  all  hhs  sbir 
awards,  and  we  therefore  focused  our  siuvey  efforts  on  nih’s  awardees.  As 
suggested  by  hhs,  we  have  changed  our  report  to  refer  to  hhs  as  the 
participating  agency.  We  have  retained  references  to  nih  only  in  discussing 
the  conunents  provided  to  us  by  the  nih  program  manager. 

2.  We  have  modified  the  report  to  indicate  that  sem  fimding  agreements 
may  include  contracts,  grants,  or  cooperative  agreements. 

3.  We  believe  that  figure  2.2  provides  important  information  about  the  sbir 
Program.  In  measuring  the  aggregate  commercial  results  of  the  program, 
the  distribution  of  projects  by  time  of  first  sale  helps  to  understand  how 
recently  much  of  the  initial  sbir  sales  activity  has  occurred.  In  coi\junction 
with  our  further  finding  that  most  of  these  projects  reporting  actual  sales 
also  expect  further  sales,  the  data  give  a  valuable  overview  of  the  progress 
of  the  program. 

4.  We  have  added  a  footnote  on  page  40  in  response  to  hhs’  clarification. 
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See  comment  1. 
Now  on  p.  39. 


Now  on  p.  39. 


NATIONAL  SCIENCE  FOUNDATION 

WASHINGTON  D  C  20550 

nsf 


OFFICE  OF  THE 

DIRECTOR  December  13,  1991 


Mr.  John  M.  01s,  Jr. 

Director,  Housing  and 

Conununlty  Development  Issues 
United  States  General  Accounting  Office 
Washington,  DC  20548 

Dear  Mr.  01s : 

This  letter  responds  to  your  reguest  of  November  26,  1991  for 
NSF's  review  and  comments  on  your  draft  report  entitled  "Federal 
Research;  Small  Business  Innovation  Research  Shows  Success  But 
Can  Be  Strengthened"  (GAO/RCED-92-37 ) .  In  our  view,  the  report 
presents  a  well  reasoned  and  balanced  review  of  the  program. 

It  is  not  surprising  that  there  is  a  variance  in  Federal  Agency 
commercialization  efforts  from  results  obtained  in  Phases  I  and 

II  of  the  SBIR  Program.  This  could  stem  from  the  wide  and 
varying  objectives  and  missions  of  the  agencies.  Your  findings 
r«;lative  to  issues  that  should  be  addressed  to  strengthen  Phase 

III  activity  raise  questions  and  opportunities  that  need  to  be 
clarified  if  a  coordinated,  government -wide  effort  is  to  be 
successful.  NSF  does  not  support  any  Phase  III  activities; 
instead,  we  rely  on  the  private  sector  to  bring  the  results  to 
the  market  place.  Our  own  review  of  the  Program  indicates  that 
research  of  high  quality  has  been  carried  out  by  small 
technology- intensive  firms  and  that  many  of  these  firms  have  been 
successful  in  bringing  new  technology,  products  and  services  to 
the  market. 

The  following  comments  and  suggestions  are  provided  to  clarify 
statements  related  to  NSF's  activities: 

a.  Page  44,  1st  paragraph:  NSF  has  three  SBIR  Program 
Managers.  Suggested  rewrite:  "As  an  important  part  of 
agency  efforts  to  enhance  private  sector  commerciali¬ 
zation,  one  NSF  program  manager  noted  NSF's  policy  of 
placing  strong  emphasis  on  a  follow-on  funding 
commitment  for  potential  Phase  II  awardees.  He  said 
that  potential  awardees  have  been  encouraged  as  hard 
about  the  commercial  applications  as  about  the 
research. " 

b.  Page  44,  2nd  paragraph,  2nd  sentence:  NSF  does  not 
require  that  a  company  complete  the  NSF  forms .  The 
sentence  should  read  "NSF  has  also  developed  formal 
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The  following  are  gao’s  conunents  on  nsf’s  letter  dated  December  13, 1991. 


GAO  Comments 


1.  The  revisions  and  deletions  that  nsf  requested  have  been  made  at 
appropriate  places  in  the  report 
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Comments  From  the  Small  Business 
Administration 


See  comment  1 . 


See  comment  2. 


See  comment  3. 


U.S.  Small  business  Administration 

Washington.  D.C.  20416 


I  A  isffi 

Hr.  J.  Dexter  Peach 
Assistant  Comptroller  General 
Resources,  Community  and  Economic 
Development  Division 
United  States  General  Accounting  Office 
Washington,  D.C.  20548 

Dear  Mr.  Peach: 

We  have  reviewed  your  draft  report  entitled  "Federal 
Research:  Small  Business  Innovation  Research  Shows  Success  But 
Can  Be  Strengthened"  (GAO/RCED-92-37) . 

While  we  found  the  report  to  be  professionally  accomplished 
and  a  very  meaningful  examination  of  specific  aspects  of  the 
Small  Business  Innovation  Research  (SBIR)  program  activities,  the 
Small  Business  Administration  (SBA)  does  not  concur  in  GAO's 
recommendation  that  the  Administrator  should  develop  a  policy 
statement  for  agencies  that  are  planning  to  work  on  a  company's 
SBIR  technology  after  the  end  of  SBIR  funding.  The  present 
legislation  (P.L.  97-219)  does  not  address  the  authority  of  SBA 
in  establishing  program  policy  over  non-SBIR  funding  agreements. 
We  believe  these  agreements  should  be  subject  to  the  procurement 
regulations  of  the  participating  agencies. 

In  addition,  we  are  providing  the  following  comments  for 
clarification  of  certain  issues: 

In  several  sections  of  the  report,  there  are  references 
indicating  that  the  SBA  publishes  "policy  guidelines". 
The  word  guidelines  is  somewhat  misleading.  We  issue 
SBIR  Policy  Directives  which,  in  effect,  establish  how 
things  must  be  done.  The  first  Policy  Directive  was 
disseminated  in  November  of  1982. 

There  are  several  suggestions  in  the  report  that  SBA 
issue  policy  directives  to  participating  agencies 
concerning  the  solicitation  and  award  of  non-SBIR  Phase 
III  funding  agreements.  These  suggestions  concern  the 
need  for  competition  for  funding  agreements  past  Phase 
II.  As  you  are  aware,  the  SBA  provided  our  views  on 
this  matter  to  GAO  in  a  letter  to  your  Office  of 
General  Counsel  on  June  10,  1991.  In  that  letter,  we 
expressed  our  opinion  that  participating  agencies  could 
allow  SBIR  firms  to  proceed  into  Phase  III  without 
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See  comment  4. 


See  comment  5. 


See  comment  6. 


See  comment  7. 


further  competition  by  exemption  from  the  Competition 
in  Contracting  Act.  In  any  case,  the  agreements  should 
be  stibject  to  the  procurement  regulations  of  the 
participating  agency,  not  SBA.  The  progreun  legislation 
(P.L.  97-219)  does  not  address  the  authority  of  SBA  in 
establishing  program  policy  over  non-SBIR  funding 
agreements. 

The  report  discusses  those  firms  in  the  SBIR  program 
that  have  won  more  than  five  Phase  II  awards.  The 
report  infers  that  SBA  is  undertaking  a  study  of  these 
winners  of  multiple  awards  to  examine  the  "somewhat 
lower  level  of  performance"  among  them.  While  SBA  is 
undertaking  a  study  to  determine  the  operating 
attributes  of  these  firms,  we  have  in  no  way  assumed 
that  they  can  or  should  be  characterized  as  having  a 
lower  or  higher  level  of  performance. 

The  report  discusses  the  National  Science  Foundation 
(NSF)  policy  of  regulring  proof  of  a  third  party 
follow-on  funding  commitment  for  potential  Phase  II 
awardees  as  essential  for  receiving  the  SBIR  Phase  II 
award.  In  addition  to  the  concerns  expressed  in  the 
report,  the  NSF  requirement  exceeds  the  legislation. 
Under  the  law,  consideration  of  third  party  follow-on 
funding  commitments  is  only  appropriate  in  instances 
where  there  is  a  tie  between  two  or  more  proposals. 
Requiring  such  commitments  also  places  additional  work 
on  the  contractor. 

The  report  discusses  agencies  that  are  considering 
using  company  performance,  i.e.  commercialization,  as  a 
factor  in  their  SBIR  selections.  We  believe  this  may 
be  legally  questionable  and  could  result  in  legal 
action  by  bidders  who  failed  to  receive  contracts  due 
to  this  factor.  There  are  many  reasons  why  procedures 
resulting  from  research  are  not  commercialized,  such  as 

(1)  the  procedure  proved  to  be  technically  infeasible, 

(2)  the  procedure  could  be  part  of  a  larger  system 
under  development,  and  (3)  the  procedure  may  require  a 
three-contract  phase  to  reach  full  development. 
Therefore,  company  performance  in  Phase  III  should  not 
be  a  factor  in  agencies'  SBIR  procurement  selection 
decisions. 

The  report  states  that  SBA's  Assistant  Administrator, 
Office  of  Innovation,  Research  and  Technology,  said  his 
"  ...  office  found  major  difficulties  in  using  the  SBIR 
data  from  its  survey  to  evaluate  the  program."  Another 
sentence  should  be  substituted  which  states,  "The  SBA's 
Assistant  Administrator,  Office  of  Innovation,  Research 
and  Technology,  said  that  difficulties  were  experienced 
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in  datsmlnlng  a  auitabla  daslgn  and  aathodology  for 
tha  conduct  of  SBA's  study  bacausa  no  known  slnllar 
study  had  baan  parfonad  in  Fadaral  MD  procuraaant." 

Thank  you  for  tha  opportunity  to  cosnant  on  tha  draft 
report.  If  you  need  additional  Infomation,  plaasa  contact 
Mr.  Petar  L.  McClintock,  Assistant  Inspector  Oanaral  for 
Auditing,  at  205-6590. 


Sincerely, 


Patricia  Saiki 
Adainistrator 
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The  following  are  gao’s  conunents  on  sba’s  letter  dated  January  14, 1992. 


GAO  Comments 


1.  We  discuss  this  conunent  on  pages  7  and  52  of  our  report 

2.  All  references  to  sba  “policy  statements”  have  been  deleted  fixim  the 
report  and  replaced  with  “poUcy  directives.” 

3.  SBA  describes  our  draft  report  as  containing  “several  suggestions  that  sba 
issue  policy  directives  to  participating  agencies  concerning  the 
solicitiation  and  award  of  non-SBIR  Phase  m  funding  agreements.”  In  our 
draft  report,  we  clearly  presented  this  issue  as  a  matter  for  congressional 
consideration.  We  also  made  two  references  to  sba’s  policy  role  in  this 
regard.  In  one,  we  stated  that  sba  policy  guidelines  do  not  address  this 
issue;  in  the  other,  we  stated  that  we  were  informally  advised  that  sba  was 
considering  a  change  to  its  policy  directive  regarding  acA  competition 
requirements.  Although  both  references  were  accurate,  we  have  deleted 
them  to  avoid  any  implication  that  this  issue  was  directed  to  sba.  As  stated 
in  our  draft  report,  the  issue  remains  a  matter  for  congressional 
consideration. 

4.  We  have  revised  the  executive  summary  to  clarify  that  sba  is 
undertaking  a  study  of  the  operating  attributes  of  frequent  winners.  We 
have  also  added  a  footnote  on  page  68  to  indicate  that  sba  is  making  no 
assumptions  about  the  level  of  performance  among  frequent  winners. 

5.  NSF  clarified  its  position  regarding  this  issue  in  its  agency  comments  on 
our  report  We  have  made  the  changes  requested  by  nsf.  In  our  view,  nsf's 
clarification  responds  to  the  concerns  expressed  by  sba. 

6.  We  have  added  a  footnote  on  page  67  to  clarify  this  issue. 

7.  We  have  made  the  revision  requested  by  sba. 
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Appendix  VI _ 

Major  Contributors  to  This  Report 


Resources, 

Community,  and 
Economic 

Development  Division, 
Washington,  D.C. 


Lowell  Mininger,  Assistant  Director,  (202)  566-1111 

Dennis  Carroll,  Evaluator-in-Charge 

Alice  Feldesman,  Supervisory  Social  Science  Analyst 


Dffice  of  the  General  Webenbloom,  senior  Attorney 

Counsel 
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